Sep 23 00:05:00 devstack cinder-volume[75374]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:05:00 devstack cinder-volume[75374]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:05:00 devstack cinder-volume[75374]: we strongly recommend against using it for new projects. Sep 23 00:05:00 devstack cinder-volume[75374]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:05:00 devstack cinder-volume[75374]: framework. For more detail see Sep 23 00:05:00 devstack cinder-volume[75374]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:05:00 devstack cinder-volume[75374]: import eventlet # noqa Sep 23 00:05:03 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:05:03 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:05:03 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:05:04 devstack cinder-volume[75374]: INFO dbcounter [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Registered counter for database cinder Sep 23 00:05:04 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:04 devstack cinder-volume[75374]: DEBUG dbcounter [-] [75374] Writer thread running {{(pid=75374) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:04 devstack cinder-volume[75374]: INFO cinder.rpc [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:05:04 devstack cinder-volume[75374]: INFO cinder.rpc [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:05 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Determined volume DB was empty at startup. Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG cinder.volume.manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75374) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:05:05 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:05:05 devstack cinder-volume[75374]: WARNING stevedore.named [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:05 devstack cinder-volume[75374]: WARNING castellan.key_manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:05 devstack cinder-volume[75374]: WARNING cinder.keymgr.conf_key_mgr [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG cinder.volume.drivers.lvm [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75374) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_concurrency.processutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75374) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_concurrency.processutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=75374) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:05 devstack cinder-volume[75374]: INFO cinder.rpc [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:05:05 devstack cinder-volume[75374]: INFO cinder.rpc [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:05:05 devstack cinder-volume[75374]: WARNING stevedore.named [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:05 devstack cinder-volume[75374]: WARNING castellan.key_manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:05 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:05 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Starting 1 workers Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Started child 75534 {{(pid=75374) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Full set of CONF: {{(pid=75374) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:05:05 devstack cinder-volume[75534]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] ******************************************************************************** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Configuration options gathered from: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] ================================================================================ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] allow_availability_zone_fallback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] allow_compression_on_image_upload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] allowed_direct_url_schemes = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] api_rate_limit = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] auth_strategy = keystone {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] az_cache_duration = 3600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_host = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_stats_polling_interval = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backup_api_class = cinder.backup.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backup_name_template = backup-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backup_use_same_host = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backup_use_temp_snapshot = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75534]: INFO cinder.volume.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:05 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] chap_username = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_internal_tenant_project_id = 422add34414b4778aa850bec113d7648 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_internal_tenant_user_id = 5e3ecc45339c4117929ef23e705e7421 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cloned_volume_same_az = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cluster = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] compression_format = gzip {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] compute_api_class = cinder.compute.nova.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] config_dir = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] config_source = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] control_exchange = openstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] debug = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] default_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] default_group_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] default_volume_type = lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] deployment_max_gigabytes = -1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_ssl_cert_verify = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] driver_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] enable_force_upload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] enable_new_services = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] enable_unsupported_driver = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] enforce_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_api_insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_api_ssl_compression = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_ca_certificates_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_catalog_info = image:glance:publicURL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_num_retries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance_request_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] graceful_shutdown_timeout = 5 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] group_api_class = cinder.group.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] host = devstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_compress_on_upload = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_conversion_address_space_limit = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_conversion_cpu_limit = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_conversion_disable = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_introspection_address_space_limit = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_introspection_cpu_limit = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_upload_use_cinder_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_upload_use_internal_tenant = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_volume_cache_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_volume_cache_max_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] image_volume_cache_max_size_gb = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:05 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] init_host_max_objects_retrieval = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] instance_format = [instance: %(uuid)s] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iscsi_target_flags = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iscsi_write_cache = on {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iser_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iser_ip_address = 192.168.122.128 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iser_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_color = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_config_append = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_options = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_rotate_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_rotate_interval_type = days {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] log_rotation_type = none {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] max_age = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] max_logfile_count = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] max_logfile_size_mb = 200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] max_over_subscription_ratio = 20.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] message_reap_interval = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] message_ttl = 2592000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] migration_create_volume_timeout_secs = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] monkey_patch = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] monkey_patch_modules = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] my_ip = 192.168.122.128 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] no_snapshot_gb_quota = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] num_iser_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] num_shell_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] num_volume_device_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] nvmeof_conn_info_version = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] nvmet_ns_id = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] nvmet_port_id = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_max_limit = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_ext_list = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_listen_port = 8776 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] osapi_volume_workers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] per_volume_size_limit = -1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] periodic_fuzzy_delay = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] periodic_interval = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] public_endpoint = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] publish_errors = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_backup_gigabytes = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_backups = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_gigabytes = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_groups = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_snapshots = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] quota_volumes = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] rate_limit_burst = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] rate_limit_except_level = CRITICAL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] rate_limit_interval = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] reinit_driver_count = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] report_discard_supported = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] report_interval = 120 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] reservation_clean_interval = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] reservation_expire = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] reserved_image_namespaces = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] reserved_percentage = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] rpc_response_timeout = 120 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] run_external_periodic_tasks = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] scst_target_driver = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_down_time = 720 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] shell_completion = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] snapshot_name_template = snapshot-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] snapshot_same_host = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] state_path = /opt/stack/data/cinder {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] storage_availability_zone = nova {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] storage_protocol = iSCSI {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] syslog_log_facility = LOG_USER {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_helper = lioadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_ip_address = 192.168.122.128 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack sudo[75542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:05:06 devstack sudo[75542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] target_secondary_ip_addresses = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] transport_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] until_refresh = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_chap_auth = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_default_quota_class = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_journal = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_json = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_stderr = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] use_syslog = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] verify_glance_signatures = enabled {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_api_class = cinder.volume.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_clear_size = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_copy_bps_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_dd_blocksize = 1M {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_name_template = volume-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_service_inithost_offload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volume_usage_audit_period = month {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] zoning_mode = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_concurrency.disable_process_locking = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.auth_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.cache = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.include_service_catalog = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.interface = public {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcache_username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.service_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.backend = dogpile.cache.null {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.backend_argument = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.backend_expiration_time = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.config_prefix = cache.oslo {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.debug_cache_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.enable_retry_client = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.enable_socket_keepalive = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.expiration_time = 600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.hashclient_retry_attempts = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_dead_retry = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_pool_maxsize = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_sasl_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.proxies = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.redis_db = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.redis_server = localhost:6379 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.retry_attempts = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.retry_delay = 0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.socket_keepalive_count = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.socket_keepalive_idle = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.socket_keepalive_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.socket_timeout = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.tls_allowed_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.tls_cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.tls_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.tls_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.tls_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cache.username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] coordination.backend_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.asyncio_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.asyncio_slave_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.backend = sqlalchemy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.connection_debug = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.connection_parameters = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.connection_recycle_time = 3600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.connection_trace = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.db_inc_retry_interval = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.db_max_retries = 20 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.db_max_retry_interval = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.db_retry_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.max_overflow = 50 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.max_pool_size = 5 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.max_retries = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.mysql_wsrep_sync_wait = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.pool_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.retry_interval = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.slave_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.sqlite_synchronous = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.synchronous_reader = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] database.use_db_reconnect = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_tracing.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.connection_string = messaging:// {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.es_doc_type = notification {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.es_scroll_size = 10000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.es_scroll_time = 2m {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.filter_error_trace = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.hmac_keys = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.sentinel_service_name = mymaster {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.socket_timeout = 0.1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.trace_requests = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler.trace_sqlalchemy = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler_jaeger.process_tags = {} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler_jaeger.service_name_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] profiler_otlp.service_name_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.enforce_new_defaults = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.policy_default_rule = default {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.policy_file = policy.yaml {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.group = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.helper_command = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] privsep_osbrick.user = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.group = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.helper_command = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] cinder_sys_admin.user = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.send_service_user_token = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] service_user.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] glance.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.chap_username = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.driver_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.extra_capabilities = {} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iscsi_target_flags = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iscsi_write_cache = on {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iser_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iser_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.lvm_share_target = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.lvm_type = auto {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.num_shell_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.report_discard_supported = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.reserved_percentage = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.unique_fqdn_network = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.use_chap_auth = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_clear_size = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_reports.file_event_handler = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_reports.log_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.backend_host = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.chap_username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.extra_capabilities = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iser_helper = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iser_ip_address = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iser_port = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.lvm_share_target = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.lvm_type = auto {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.num_shell_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.report_discard_supported = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.reserved_percentage = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.scst_target_driver = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.storage_protocol = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_helper = lioadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_ip_address = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.use_chap_auth = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_clear_size = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] lvmdriver-1.volumes_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_notifications.driver = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_notifications.retry = -1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] key_manager.fixed_key = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.barbican_api_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.barbican_endpoint = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.barbican_endpoint_type = public {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.barbican_region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.number_of_retries = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.retry_delay = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.send_service_user_token = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.verify_ssl = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican.verify_ssl_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.auth_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] barbican_service_user.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.approle_role_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.approle_secret_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.auth_method = approle {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.auth_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.kv_mountpoint = secret {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.kv_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.kv_version = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.root_token_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.ssl_ca_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.token_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.token_role = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:06 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] ******************************************************************************** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:05:06 devstack sudo[75542]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack sudo[75545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:06 devstack sudo[75545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack sudo[75545]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.309s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:05:06 devstack cinder-volume[75534]: INFO cinder.brick.local_dev.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack sudo[75549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:06 devstack sudo[75549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:06 devstack sudo[75549]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG cinder.brick.local_dev.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75534) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:05:06 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:06 devstack sudo[75593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:06 devstack sudo[75593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:07 devstack sudo[75593]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:07 devstack sudo[75840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:07 devstack sudo[75840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:07 devstack sudo[75840]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:07 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:07 devstack sudo[75954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:05:07 devstack sudo[75954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:08 devstack sudo[75954]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:08 devstack sudo[76068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:08 devstack sudo[76068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:08 devstack sudo[76068]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:08 devstack sudo[76153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:08 devstack sudo[76153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:08 devstack sudo[76153]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:08 devstack sudo[76156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:08 devstack sudo[76156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:08 devstack sudo[76156]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:08 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:08 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:09 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:09 devstack sudo[76243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:09 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:09 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:09 devstack cinder-volume[75534]: INFO cinder.volume.drivers.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:09 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:09 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:09 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:09 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:09 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:10 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:10 devstack sudo[76339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:10 devstack sudo[76339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:10 devstack sudo[76339]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:10 devstack sudo[76348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:10 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:10 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:10 devstack sudo[76351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:10 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:10 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:10 devstack cinder-volume[75534]: INFO cinder.volume.driver [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG cinder.volume.driver [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75534) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:05:10 devstack cinder-volume[75534]: DEBUG oslo_db.sqlalchemy.engines [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writer thread running {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG cinder.db.api [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Building query based on filter {{(pid=75534) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG cinder.image.image_utils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75534) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:05:11 devstack cinder-volume[75534]: INFO cinder.keymgr.migration [None req-59020065-cc93-499b-b2e8-1951a5ebfd85 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:11 devstack sudo[76356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:11 devstack sudo[76356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:11 devstack sudo[76356]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:11 devstack sudo[76359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:11 devstack sudo[76359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:11 devstack sudo[76359]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:11 devstack sudo[76362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:11 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:11 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:11 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:11 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:11 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:12 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG cinder.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Notifying Schedulers of capabilities ... {{(pid=75534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:12 devstack cinder-volume[75534]: INFO cinder.volume.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Driver initialization completed successfully. Sep 23 00:05:12 devstack cinder-volume[75534]: INFO cinder.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Initiating service 2 cleanup Sep 23 00:05:12 devstack cinder-volume[75534]: INFO cinder.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Service 2 cleanup completed. Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG cinder.service [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Creating RPC server for service cinder-volume {{(pid=75534) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG cinder.service [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75534) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:05:12 devstack cinder-volume[75534]: INFO cinder.volume.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:12 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:12 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:12 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:12 devstack sudo[76373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:12 devstack sudo[76373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:12 devstack sudo[76373]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:12 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:12 devstack sudo[76376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:12 devstack sudo[76376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:13 devstack sudo[76376]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:13 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:13 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:13 devstack sudo[76382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:13 devstack sudo[76382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:13 devstack sudo[76382]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:13 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:13 devstack cinder-volume[75534]: INFO cinder.volume.manager [None req-eaf285f3-9768-48a6-a0a7-e37f0f46e54c None None] Driver post RPC initialization completed successfully. Sep 23 00:05:15 devstack cinder-volume[75374]: DEBUG dbcounter [-] [75374] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75374) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:05:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:08 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:08 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:06:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:08 devstack sudo[78321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:06:08 devstack sudo[78321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:08 devstack sudo[78321]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:08 devstack sudo[78364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:08 devstack sudo[78364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:09 devstack sudo[78364]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:09 devstack sudo[78367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:06:09 devstack sudo[78367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:09 devstack sudo[78367]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:09 devstack sudo[78370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:09 devstack sudo[78370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:09 devstack sudo[78370]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG cinder.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Notifying Schedulers of capabilities ... {{(pid=75534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager._thread_info {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG cinder.volume.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] thread count: 6 {{(pid=75534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:06:09 devstack cinder-volume[75534]: DEBUG cinder.volume.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] thread info: [<_MainThread(MainThread, started 138120526647424)>, , , , , ] {{(pid=75534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:08 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:08 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:08 devstack sudo[81626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:08 devstack sudo[81626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:08 devstack sudo[81626]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:08 devstack sudo[81631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:08 devstack sudo[81631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:09 devstack sudo[81631]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:09 devstack sudo[81634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:09 devstack sudo[81634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:09 devstack sudo[81634]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:09 devstack sudo[81653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:09 devstack sudo[81653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:09 devstack sudo[81653]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:09 devstack cinder-volume[75534]: DEBUG cinder.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Notifying Schedulers of capabilities ... {{(pid=75534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:07:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:SELECT=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:07:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:UPDATE=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:08 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:08 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:08 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:08 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:08 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:08 devstack sudo[83517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:08 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:09 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:09 devstack sudo[83525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:09 devstack sudo[83525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:09 devstack sudo[83525]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:09 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:09 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:09 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG cinder.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Notifying Schedulers of capabilities ... {{(pid=75534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager._thread_info {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG cinder.volume.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] thread count: 6 {{(pid=75534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:08:09 devstack cinder-volume[75534]: DEBUG cinder.volume.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] thread info: [<_MainThread(MainThread, started 138120526647424)>, , , , , ] {{(pid=75534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:09:08 devstack cinder-volume[75534]: DEBUG oslo_service.periodic_task [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:08 devstack cinder-volume[75534]: DEBUG cinder.volume.drivers.lvm [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Updating volume stats {{(pid=75534) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:09:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:08 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:09:08 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:08 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:08 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:08 devstack sudo[84762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:08 devstack sudo[84762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:09 devstack sudo[84762]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:09 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:09:09 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:09 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:09 devstack sudo[84771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:09 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:09 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG oslo_concurrency.processutils [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:09 devstack cinder-volume[75534]: DEBUG cinder.manager [None req-dc10f812-07a1-437d-8c43-0ce6f607423d None None] Notifying Schedulers of capabilities ... {{(pid=75534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:SELECT=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:23 devstack cinder-volume[75534]: DEBUG dbcounter [-] [75534] Writing DB stats cinder:UPDATE=1 {{(pid=75534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:44 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Caught SIGTERM, stopping children Sep 23 00:09:44 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Acquiring lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:44 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Acquired lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:44 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Releasing lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:44 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Stop services. {{(pid=75374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:09:44 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Killing children. {{(pid=75374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:09:44 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Waiting on 1 children to exit Sep 23 00:09:47 devstack cinder-volume[75534]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Acquiring lock "singleton_lock" {{(pid=75534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:47 devstack cinder-volume[75534]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Acquired lock "singleton_lock" {{(pid=75534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:47 devstack cinder-volume[75534]: DEBUG oslo_concurrency.lockutils [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Releasing lock "singleton_lock" {{(pid=75534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:47 devstack cinder-volume[75534]: WARNING amqp [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:47 devstack cinder-volume[75534]: WARNING amqp [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:47 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-b3671234-5715-4527-b58c-5384ad3f9b0d None None] Child 75534 exited with status 0 Sep 23 00:09:47 devstack cinder-volume[85580]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:09:47 devstack cinder-volume[85580]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:09:47 devstack cinder-volume[85580]: we strongly recommend against using it for new projects. Sep 23 00:09:47 devstack cinder-volume[85580]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:09:47 devstack cinder-volume[85580]: framework. For more detail see Sep 23 00:09:47 devstack cinder-volume[85580]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:09:47 devstack cinder-volume[85580]: import eventlet # noqa Sep 23 00:09:50 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:50 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:50 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:51 devstack cinder-volume[85580]: INFO dbcounter [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Registered counter for database cinder Sep 23 00:09:51 devstack cinder-volume[85580]: DEBUG oslo_db.sqlalchemy.engines [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85580) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:51 devstack cinder-volume[85580]: DEBUG dbcounter [-] [85580] Writer thread running {{(pid=85580) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:51 devstack cinder-volume[85580]: INFO cinder.rpc [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:09:52 devstack cinder-volume[85580]: INFO cinder.rpc [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_db.sqlalchemy.engines [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85580) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:52 devstack cinder-volume[85580]: INFO cinder.volume.manager [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Determined volume DB was empty at startup. Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG cinder.volume.manager [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85580) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:09:52 devstack cinder-volume[85580]: INFO cinder.volume.manager [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:09:52 devstack cinder-volume[85580]: WARNING stevedore.named [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:09:52 devstack cinder-volume[85580]: WARNING castellan.key_manager [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:52 devstack cinder-volume[85580]: WARNING cinder.keymgr.conf_key_mgr [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:52 devstack cinder-volume[85580]: INFO cinder.volume.manager [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_db.sqlalchemy.engines [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85580) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:52 devstack cinder-volume[85580]: INFO oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Starting 1 workers Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Started child 85825 {{(pid=85580) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Full set of CONF: {{(pid=85580) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] ******************************************************************************** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Configuration options gathered from: {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:09:52 devstack cinder-volume[85825]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] ================================================================================ {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] allow_availability_zone_fallback = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] allow_compression_on_image_upload = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] allowed_direct_url_schemes = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] api_rate_limit = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] auth_strategy = keystone {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_availability_zone = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_host = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_stats_polling_interval = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backup_api_class = cinder.backup.api.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backup_name_template = backup-%s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backup_use_same_host = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backup_use_temp_snapshot = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] chap_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] chap_username = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_internal_tenant_project_id = 422add34414b4778aa850bec113d7648 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_internal_tenant_user_id = 5e3ecc45339c4117929ef23e705e7421 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cluster = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] compression_format = gzip {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] config_dir = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] config_source = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] control_exchange = openstack {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] debug = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] default_availability_zone = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] default_group_type = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] default_volume_type = QuobyteHD {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] deployment_max_gigabytes = -1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] disk_geometry = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_client_cert = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_client_cert_key = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_data_namespace = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_ssl_cert_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_ssl_cert_verify = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] driver_use_ssl = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] enable_new_services = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] enable_unsupported_driver = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] enabled_backends = ['QuobyteHD'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] enforce_multipath_for_image_xfer = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] filter_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_api_insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_api_ssl_compression = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_ca_certificates_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_num_retries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance_request_timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] goodness_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] graceful_shutdown_timeout = 5 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] group_api_class = cinder.group.api.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] host = devstack {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_compress_on_upload = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_conversion_address_space_limit = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_conversion_cpu_limit = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_conversion_disable = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_introspection_address_space_limit = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_introspection_cpu_limit = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_upload_use_cinder_backend = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_upload_use_internal_tenant = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_volume_cache_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_volume_cache_max_count = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] init_host_max_objects_retrieval = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] instance_format = [instance: %(uuid)s] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iscsi_target_flags = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iscsi_write_cache = on {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iser_helper = tgtadm {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iser_ip_address = 192.168.122.128 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iser_port = 3260 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85825]: INFO cinder.volume.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.remotefs [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85825) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_color = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_config_append = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_dir = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_options = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_rotate_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_rotate_interval_type = days {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] log_rotation_type = none {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] max_age = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] max_logfile_count = 30 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] max_logfile_size_mb = 200 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] max_over_subscription_ratio = 20.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] message_reap_interval = 86400 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] message_ttl = 2592000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] monkey_patch = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] monkey_patch_modules = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] my_ip = 192.168.122.128 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] no_snapshot_gb_quota = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] num_iser_scan_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] num_shell_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] num_volume_device_scan_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] nvmeof_conn_info_version = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] nvmet_ns_id = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] nvmet_port_id = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_max_limit = 1000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_ext_list = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_listen_port = 8776 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_use_ssl = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] osapi_volume_workers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] per_volume_size_limit = -1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] periodic_fuzzy_delay = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] periodic_interval = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] public_endpoint = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] publish_errors = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_backup_gigabytes = 1000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_backups = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_gigabytes = 1000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_groups = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_snapshots = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] quota_volumes = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] rate_limit_burst = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] rate_limit_except_level = CRITICAL {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] rate_limit_interval = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] reinit_driver_count = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] replication_device = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] report_discard_supported = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] report_interval = 120 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] reservation_clean_interval = 86400 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] reservation_expire = 86400 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] reserved_image_namespaces = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] reserved_percentage = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] rpc_response_timeout = 120 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] run_external_periodic_tasks = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] scst_target_driver = iscsi {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] scst_target_iqn_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_down_time = 720 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] shell_completion = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] snapshot_name_template = snapshot-%s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] split_loggers = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] state_path = /opt/stack/data/cinder {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] storage_availability_zone = nova {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] storage_protocol = iSCSI {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] syslog_log_facility = LOG_USER {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_helper = lioadm {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_ip_address = 192.168.122.128 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_port = 3260 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_protocol = iscsi {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] target_secondary_ip_addresses = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] trace_flags = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] transport_url = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] until_refresh = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_chap_auth = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_default_quota_class = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_journal = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_json = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_multipath_for_image_xfer = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_stderr = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] use_syslog = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] verify_glance_signatures = enabled {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_api_class = cinder.volume.api.API {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_backend_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_clear = zero {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_clear_ionice = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_clear_size = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_copy_bps_limit = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_dd_blocksize = 1M {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_name_template = volume-%s {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_service_inithost_offload = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volume_usage_audit_period = month {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] zoning_mode = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.auth_section = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.auth_type = password {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.auth_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.cache = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.interface = public {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcache_username = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.region_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.service_type = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.backend = dogpile.cache.null {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.backend_argument = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.backend_expiration_time = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.config_prefix = cache.oslo {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.debug_cache_backend = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.enable_retry_client = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.enable_socket_keepalive = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.expiration_time = 600 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_dead_retry = 300 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_sasl_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.proxies = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.redis_db = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.redis_server = localhost:6379 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.retry_attempts = 2 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.retry_delay = 0.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.socket_keepalive_count = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.socket_keepalive_idle = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.socket_keepalive_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.socket_timeout = 1.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.tls_allowed_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.tls_cafile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.tls_certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85825) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.tls_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: WARNING cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:09:52 devstack cinder-volume[85825]: WARNING cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.tls_keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cache.username = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] coordination.backend_url = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.asyncio_connection = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.asyncio_slave_connection = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.backend = sqlalchemy {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.connection = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.connection_debug = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.connection_parameters = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.connection_recycle_time = 3600 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.connection_trace = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Running cmd (subprocess): mount.quobyte {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.db_inc_retry_interval = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.db_max_retries = 20 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.db_max_retry_interval = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.db_retry_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.max_overflow = 50 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.max_pool_size = 5 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.max_retries = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.pool_timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.retry_interval = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.slave_connection = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.sqlite_synchronous = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.synchronous_reader = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] database.use_db_reconnect = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_tracing.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.connection_string = messaging:// {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.es_doc_type = notification {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.es_scroll_size = 10000 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.es_scroll_time = 2m {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.filter_error_trace = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.hmac_keys = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.sentinel_service_name = mymaster {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.socket_timeout = 0.1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.trace_requests = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler.trace_sqlalchemy = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler_jaeger.process_tags = {} {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] profiler_otlp.service_name_prefix = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.policy_default_rule = default {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.group = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.helper_command = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] privsep_osbrick.user = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.group = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.helper_command = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] cinder_sys_admin.user = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.auth_section = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.auth_type = password {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.cafile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.collect_timing = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.send_service_user_token = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.split_loggers = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.tls_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] service_user.tls_min_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.auth_section = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.auth_type = password {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.collect_timing = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.region_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.split_loggers = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.tls_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] glance.tls_min_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.backend_availability_zone = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.chap_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.chap_username = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.disk_geometry = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_client_cert = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_data_namespace = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.driver_use_ssl = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.extra_capabilities = {} {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.filter_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack quobyte-client[85831]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:09:52 devstack quobyte-client[85831]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.goodness_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iscsi_target_flags = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iser_port = 3260 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_host = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_login = admin {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_mount_options = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_private_key = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=85825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_share_path = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85825]: INFO cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 ... Sep 23 00:09:52 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 -c /etc/quobyte/client-cinder.cfg {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.quobyte_volume_url = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.replication_device = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.report_discard_supported = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_helper = tgtadm {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_port = 3260 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_protocol = iscsi {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.trace_flags = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 -c /etc/quobyte/client-cinder.cfg Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.use_chap_auth = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_backend_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_clear = zero {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_reports.file_event_handler = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_reports.log_dir = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.backend_availability_zone = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.backend_host = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.chap_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.chap_username = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.chiscsi_conf = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.disk_geometry = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_client_cert = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_data_namespace = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.driver_use_ssl = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.extra_capabilities = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.filter_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.goodness_function = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iser_helper = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iser_ip_address = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iser_port = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.iser_target_prefix = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_host = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_login = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_mount_options = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_password = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_private_key = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_share_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_ssh_port = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.num_shell_tries = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.nvmet_port_id = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.replication_device = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.report_discard_supported = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.reserved_percentage = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.scst_target_driver = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.storage_protocol = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_helper = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_ip_address = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_port = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_prefix = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_protocol = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.trace_flags = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.use_chap_auth = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_clear = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_clear_size = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] QuobyteHD.volumes_dir = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_notifications.driver = [] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] key_manager.fixed_key = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.barbican_api_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.barbican_endpoint = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.barbican_endpoint_type = public {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.barbican_region_name = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.cafile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.collect_timing = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.number_of_retries = 60 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.retry_delay = 1 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.send_service_user_token = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.split_loggers = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.tls_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.tls_min_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.verify_ssl = True {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican.verify_ssl_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.auth_section = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.auth_type = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.cafile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.certfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.collect_timing = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.insecure = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.keyfile = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.split_loggers = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.timeout = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.tls_ciphers = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] barbican_service_user.tls_min_version = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.approle_role_id = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.approle_secret_id = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.auth_method = approle {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.auth_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.kv_mountpoint = secret {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.kv_path = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.kv_version = 2 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.namespace = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.root_token_id = **** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.ssl_ca_crt_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.timeout = 60.0 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.token_file = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.token_role = None {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.use_ssl = False {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:52 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] ******************************************************************************** {{(pid=85580) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:09:53 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.481s {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:53 devstack cinder-volume[85825]: INFO cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 succeeded Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=85825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.496s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:53 devstack sudo[85942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:09:53 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:53 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.292s {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:53 devstack cinder-volume[85825]: INFO cinder.volume.driver [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.volume.driver [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85825) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_db.sqlalchemy.engines [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85825) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG dbcounter [-] [85825] Writer thread running {{(pid=85825) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.db.api [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Building query based on filter {{(pid=85825) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.image.image_utils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85825) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:09:53 devstack cinder-volume[85825]: INFO cinder.keymgr.migration [None req-9673fb91-1e51-445b-9839-73767a5a3169 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=85825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=85825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:53 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:09:53 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:53 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.381s {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:53 devstack cinder-volume[85825]: DEBUG cinder.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Notifying Schedulers of capabilities ... {{(pid=85825) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:53 devstack cinder-volume[85825]: INFO cinder.volume.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Driver initialization completed successfully. Sep 23 00:09:53 devstack cinder-volume[85825]: INFO cinder.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Initiating service 3 cleanup Sep 23 00:09:54 devstack cinder-volume[85825]: INFO cinder.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Service 3 cleanup completed. Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG cinder.service [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Creating RPC server for service cinder-volume {{(pid=85825) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG cinder.service [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85825) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:09:54 devstack cinder-volume[85825]: INFO cinder.volume.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=85825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG cinder.volume.drivers.quobyte [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=85825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:54 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:09:54 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:54 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:54 devstack cinder-volume[85825]: DEBUG oslo_concurrency.processutils [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.457s {{(pid=85825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:54 devstack cinder-volume[85825]: INFO cinder.volume.manager [None req-5870be5f-d765-47d7-8251-c93e2c128147 None None] Driver post RPC initialization completed successfully. Sep 23 00:09:57 devstack cinder-volume[85580]: INFO oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Caught SIGTERM, stopping children Sep 23 00:09:57 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Acquiring lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:57 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Acquired lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:57 devstack cinder-volume[85580]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Releasing lock "singleton_lock" {{(pid=85580) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:57 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Stop services. {{(pid=85580) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:09:57 devstack cinder-volume[85580]: DEBUG oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Killing children. {{(pid=85580) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:09:57 devstack cinder-volume[85580]: INFO oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Waiting on 1 children to exit Sep 23 00:09:58 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Acquiring lock "singleton_lock" {{(pid=85825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:58 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Acquired lock "singleton_lock" {{(pid=85825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:58 devstack cinder-volume[85825]: DEBUG oslo_concurrency.lockutils [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Releasing lock "singleton_lock" {{(pid=85825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:58 devstack cinder-volume[85825]: WARNING amqp [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:58 devstack cinder-volume[85825]: WARNING amqp [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:58 devstack cinder-volume[85580]: INFO oslo_service.backend._eventlet.service [None req-6d3827b7-2ad7-4382-b9de-a07c3f86d2a7 None None] Child 85825 exited with status 0 Sep 23 00:09:58 devstack cinder-volume[86202]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:09:58 devstack cinder-volume[86202]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:09:58 devstack cinder-volume[86202]: we strongly recommend against using it for new projects. Sep 23 00:09:58 devstack cinder-volume[86202]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:09:58 devstack cinder-volume[86202]: framework. For more detail see Sep 23 00:09:58 devstack cinder-volume[86202]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:09:58 devstack cinder-volume[86202]: import eventlet # noqa Sep 23 00:10:01 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:01 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:01 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:02 devstack cinder-volume[86202]: INFO dbcounter [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Registered counter for database cinder Sep 23 00:10:02 devstack cinder-volume[86202]: DEBUG oslo_db.sqlalchemy.engines [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG dbcounter [-] [86202] Writer thread running {{(pid=86202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:03 devstack cinder-volume[86202]: INFO cinder.rpc [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:10:03 devstack cinder-volume[86202]: INFO cinder.rpc [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_db.sqlalchemy.engines [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:03 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Determined volume DB was empty at startup. Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG cinder.volume.manager [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86202) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:10:03 devstack cinder-volume[86202]: WARNING stevedore.named [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:10:03 devstack cinder-volume[86202]: WARNING castellan.key_manager [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:03 devstack cinder-volume[86202]: WARNING cinder.keymgr.conf_key_mgr [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:03 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_db.sqlalchemy.engines [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:03 devstack cinder-volume[86202]: INFO oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Starting 1 workers Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Started child 86731 {{(pid=86202) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Full set of CONF: {{(pid=86202) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] ******************************************************************************** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] Configuration options gathered from: {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] ================================================================================ {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] allow_availability_zone_fallback = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] allow_compression_on_image_upload = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] allowed_direct_url_schemes = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] api_rate_limit = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86731]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] auth_strategy = keystone {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_availability_zone = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_host = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_stats_polling_interval = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backup_api_class = cinder.backup.api.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backup_name_template = backup-%s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backup_use_same_host = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backup_use_temp_snapshot = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] chap_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] chap_username = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_internal_tenant_project_id = 422add34414b4778aa850bec113d7648 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_internal_tenant_user_id = 5e3ecc45339c4117929ef23e705e7421 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cluster = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] compression_format = gzip {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] compute_api_class = cinder.compute.nova.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] config_dir = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] config_source = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] control_exchange = openstack {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] debug = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] default_availability_zone = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] default_group_type = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] default_volume_type = QuobyteHD {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] deployment_max_gigabytes = -1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] disk_geometry = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_client_cert = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_client_cert_key = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_data_namespace = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_ssl_cert_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_ssl_cert_verify = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] driver_use_ssl = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] enable_new_services = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] enable_unsupported_driver = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] enabled_backends = ['QuobyteHD'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] enforce_multipath_for_image_xfer = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] filter_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_api_insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_api_ssl_compression = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_ca_certificates_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_catalog_info = image:glance:publicURL {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86731) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_num_retries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance_request_timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] goodness_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] graceful_shutdown_timeout = 5 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] group_api_class = cinder.group.api.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] host = devstack {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_compress_on_upload = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_conversion_address_space_limit = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_conversion_cpu_limit = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_conversion_disable = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_introspection_address_space_limit = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_introspection_cpu_limit = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_upload_use_cinder_backend = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_upload_use_internal_tenant = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_volume_cache_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_volume_cache_max_count = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] image_volume_cache_max_size_gb = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] init_host_max_objects_retrieval = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] instance_format = [instance: %(uuid)s] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iscsi_target_flags = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iscsi_write_cache = on {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iser_helper = tgtadm {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iser_ip_address = 192.168.122.128 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iser_port = 3260 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_color = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_config_append = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_dir = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_options = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_rotate_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_rotate_interval_type = days {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] log_rotation_type = none {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] max_age = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] max_logfile_count = 30 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] max_logfile_size_mb = 200 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] max_over_subscription_ratio = 20.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] message_reap_interval = 86400 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] message_ttl = 2592000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] migration_create_volume_timeout_secs = 300 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] monkey_patch = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] monkey_patch_modules = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] my_ip = 192.168.122.128 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] no_snapshot_gb_quota = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] num_iser_scan_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86731) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:10:03 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:10:03 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] num_shell_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Running cmd (subprocess): mount.quobyte {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] num_volume_device_scan_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] nvmeof_conn_info_version = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] nvmet_ns_id = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] nvmet_port_id = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_max_limit = 1000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_ext_list = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_listen = 0.0.0.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_listen_port = 8776 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_use_ssl = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] osapi_volume_workers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] per_volume_size_limit = -1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] periodic_fuzzy_delay = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] periodic_interval = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] project_id_regex = [0-9a-f\-]+ {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] public_endpoint = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] publish_errors = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_backup_gigabytes = 1000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_backups = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_gigabytes = 1000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_groups = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_snapshots = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] quota_volumes = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] rate_limit_burst = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] rate_limit_except_level = CRITICAL {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] rate_limit_interval = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] reinit_driver_count = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] replication_device = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] report_discard_supported = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] report_interval = 120 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] reservation_clean_interval = 86400 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] reservation_expire = 86400 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] reserved_image_namespaces = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] reserved_percentage = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] rpc_response_timeout = 120 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] run_external_periodic_tasks = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] scst_target_driver = iscsi {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] scst_target_iqn_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_down_time = 720 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] shell_completion = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] snapshot_name_template = snapshot-%s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] split_loggers = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] state_path = /opt/stack/data/cinder {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] storage_availability_zone = nova {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] storage_protocol = iSCSI {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] syslog_log_facility = LOG_USER {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_helper = lioadm {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_ip_address = 192.168.122.128 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_port = 3260 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_protocol = iscsi {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] target_secondary_ip_addresses = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] trace_flags = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] transfer_api_class = cinder.transfer.api.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] transport_url = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] until_refresh = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_chap_auth = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_default_quota_class = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_journal = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_json = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_multipath_for_image_xfer = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_stderr = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] use_syslog = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] verify_glance_signatures = enabled {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_api_class = cinder.volume.api.API {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_backend_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_clear = zero {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_clear_ionice = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_clear_size = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_copy_bps_limit = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_dd_blocksize = 1M {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_name_template = volume-%s {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_service_inithost_offload = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volume_usage_audit_period = month {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] zoning_mode = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_concurrency.disable_process_locking = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack quobyte-client[86740]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:10:03 devstack quobyte-client[86740]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.auth_section = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.auth_type = password {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.auth_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.cache = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.delay_auth_decision = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.http_connect_timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.include_service_catalog = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.interface = public {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcache_username = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.region_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.service_token_roles_required = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.service_type = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.token_cache_time = 300 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.backend = dogpile.cache.null {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.backend_argument = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.backend_expiration_time = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.config_prefix = cache.oslo {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.debug_cache_backend = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.enable_retry_client = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.enable_socket_keepalive = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.expiration_time = 600 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.hashclient_retry_attempts = 2 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_dead_retry = 300 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_pool_maxsize = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_sasl_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.proxies = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.redis_db = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.redis_sentinel_service_name = mymaster {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.redis_server = localhost:6379 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.retry_attempts = 2 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.retry_delay = 0.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.socket_keepalive_count = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.socket_keepalive_idle = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.socket_keepalive_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.socket_timeout = 1.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.tls_allowed_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.tls_cafile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.tls_certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.tls_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.tls_keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cache.username = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] coordination.backend_url = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.asyncio_connection = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.asyncio_slave_connection = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.backend = sqlalchemy {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.connection = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.connection_debug = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.connection_parameters = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.connection_recycle_time = 3600 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.connection_trace = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.db_inc_retry_interval = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.db_max_retries = 20 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.db_max_retry_interval = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.db_retry_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.max_overflow = 50 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.max_pool_size = 5 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.max_retries = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.mysql_wsrep_sync_wait = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.pool_timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.retry_interval = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.slave_connection = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.sqlite_synchronous = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.synchronous_reader = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] database.use_db_reconnect = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_tracing.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.connection_string = messaging:// {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.es_doc_type = notification {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.es_scroll_size = 10000 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.es_scroll_time = 2m {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.filter_error_trace = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.hmac_keys = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.sentinel_service_name = mymaster {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.socket_timeout = 0.1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.trace_requests = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler.trace_sqlalchemy = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler_jaeger.process_tags = {} {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler_jaeger.service_name_prefix = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] profiler_otlp.service_name_prefix = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.enforce_new_defaults = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.policy_default_rule = default {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.policy_file = policy.yaml {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_policy.remote_timeout = 60.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.group = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.helper_command = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] privsep_osbrick.user = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.group = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.helper_command = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] cinder_sys_admin.user = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.auth_section = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:10:03 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.auth_type = password {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.cafile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.collect_timing = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.send_service_user_token = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.split_loggers = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.tls_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] service_user.tls_min_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.auth_section = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.auth_type = password {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.collect_timing = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.region_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.split_loggers = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.tls_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] glance.tls_min_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.backend_availability_zone = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.chap_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.chap_username = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.disk_geometry = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_client_cert = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_client_cert_key = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_data_namespace = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.driver_use_ssl = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.enable_unsupported_driver = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.extra_capabilities = {} {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.filter_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.goodness_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iscsi_target_flags = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iscsi_write_cache = on {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iser_helper = tgtadm {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iser_port = 3260 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_host = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_login = admin {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_mount_options = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_private_key = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_share_path = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_ssh_port = 22 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.num_shell_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.nvmet_port_id = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_client_cfg = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.quobyte_volume_url = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.replication_device = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.report_discard_supported = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.reserved_percentage = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.scst_target_driver = iscsi {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.scst_target_iqn_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.storage_protocol = iSCSI {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_helper = tgtadm {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_port = 3260 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_protocol = iscsi {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.trace_flags = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.unique_fqdn_network = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.use_chap_auth = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_backend_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_clear = zero {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_clear_ionice = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_clear_size = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_reports.file_event_handler = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_reports.log_dir = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.backend_availability_zone = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.backend_host = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.chap_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.chap_username = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.chiscsi_conf = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.disk_geometry = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_client_cert = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_client_cert_key = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_data_namespace = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.driver_use_ssl = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.extra_capabilities = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.filter_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.goodness_function = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iscsi_target_flags = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iscsi_write_cache = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iser_helper = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iser_ip_address = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iser_port = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.iser_target_prefix = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_host = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_login = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_mount_options = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_password = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_private_key = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_share_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_ssh_port = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.num_shell_tries = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nvmet_ns_id = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.nvmet_port_id = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:03 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.replication_device = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.report_discard_supported = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.reserved_percentage = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.scst_target_driver = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.storage_protocol = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_helper = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_ip_address = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_port = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_prefix = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_protocol = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.trace_flags = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.unique_fqdn_network = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.use_chap_auth = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_clear = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_clear_ionice = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_clear_size = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] QuobyteHD.volumes_dir = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.ssl_version = {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_notifications.driver = [] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_notifications.retry = -1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] oslo_messaging_notifications.transport_url = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] key_manager.fixed_key = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.barbican_api_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.barbican_endpoint = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.barbican_endpoint_type = public {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.barbican_region_name = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.cafile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.collect_timing = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.number_of_retries = 60 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.retry_delay = 1 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.send_service_user_token = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.split_loggers = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.tls_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.tls_min_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.verify_ssl = True {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican.verify_ssl_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.auth_section = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.auth_type = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.cafile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.certfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.collect_timing = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.insecure = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.keyfile = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.split_loggers = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.timeout = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.tls_ciphers = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] barbican_service_user.tls_min_version = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.approle_role_id = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.approle_secret_id = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.auth_method = approle {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.auth_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.kv_mountpoint = secret {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.kv_path = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.kv_version = 2 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.namespace = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.root_token_id = **** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.ssl_ca_crt_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.timeout = 60.0 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.token_file = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.token_role = None {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.use_ssl = False {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:04 devstack cinder-volume[86202]: DEBUG oslo_service.backend._eventlet.service [None req-bea878e1-ed1d-4c46-a083-943fba9322fe None None] ******************************************************************************** {{(pid=86202) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:10:04 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.volume.driver [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.volume.driver [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_db.sqlalchemy.engines [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writer thread running {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.db.api [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Building query based on filter {{(pid=86731) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4221}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86731) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.keymgr.migration [None req-e99e7e85-b7fe-43a7-8658-b21acd5bac4e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:10:04 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:10:04 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:04 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Driver initialization completed successfully. Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Initiating service 3 cleanup Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Service 3 cleanup completed. Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.service [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Creating RPC server for service cinder-volume {{(pid=86731) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.service [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86731) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:10:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:04 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:10:04 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:05 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fcee2e1-d57e-4571-899f-8d778d250b57 None None] Driver post RPC initialization completed successfully. Sep 23 00:10:13 devstack cinder-volume[86202]: DEBUG dbcounter [-] [86202] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:14 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 6 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:37 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:11:37 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:37 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.359s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 6 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:11:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:11:38 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Flow 'volume_create_manager' (3241f033-e5b2-4af5-94af-427c60194840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d0a9eb-fc05-4ce2-b695-732ca102d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d0a9eb-fc05-4ce2-b695-732ca102d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1052477416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96ae984-28e2-4de4-929b-ceb6079ad649,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e37f3d801a740468b1efd725e82e7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:39Z,use_quota=True,user_id='4b59909bd74c49a9940dc0baa7f97004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c021f7-f785-4c31-bc37-330d07aaa64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c021f7-f785-4c31-bc37-330d07aaa64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd0d7b2-8b1b-42ad-addd-fabd61b815a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd0d7b2-8b1b-42ad-addd-fabd61b815a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96ae984-28e2-4de4-929b-ceb6079ad649', 'volume_name': 'volume-e96ae984-28e2-4de4-929b-ceb6079ad649', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f4a235-3ed7-4875-a615-c031581b8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f4a235-3ed7-4875-a615-c031581b8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8298a1f7-ae11-41a5-b545-c8de59e5365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Volume e96ae984-28e2-4de4-929b-ceb6079ad649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96ae984-28e2-4de4-929b-ceb6079ad649', 'volume_size': 1} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1052477416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96ae984-28e2-4de4-929b-ceb6079ad649,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e37f3d801a740468b1efd725e82e7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:39Z,use_quota=True,user_id='4b59909bd74c49a9940dc0baa7f97004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Creating volume e96ae984-28e2-4de4-929b-ceb6079ad649 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:39 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:39 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 1073741824 Sep 23 00:11:39 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:39 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 1073741824" returned: 0 in 0.679s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:39 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 Sep 23 00:11:39 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:40 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649" returned: 0 in 0.335s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8298a1f7-ae11-41a5-b545-c8de59e5365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96ae984-28e2-4de4-929b-ceb6079ad649', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0eb739-64b6-4bc2-a8da-ab06a3b81dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Volume volume-e96ae984-28e2-4de4-929b-ceb6079ad649 (e96ae984-28e2-4de4-929b-ceb6079ad649): created successfully Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0eb739-64b6-4bc2-a8da-ab06a3b81dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Flow 'volume_create_manager' (3241f033-e5b2-4af5-94af-427c60194840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-aa0b165c-06b8-4e73-a650-4fdbdbb5685b req-2cc3f076-b9e8-4071-a55f-f4cc83336e7c tempest-VolumesGetTestJSON-1680560228 None] Created volume successfully. Sep 23 00:11:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Acquiring lock "cinder-e96ae984-28e2-4de4-929b-ceb6079ad649-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "cinder-e96ae984-28e2-4de4-929b-ceb6079ad649-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Acquiring lock "cinder-quobyte-e96ae984-28e2-4de4-929b-ceb6079ad649" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "cinder-quobyte-e96ae984-28e2-4de4-929b-ceb6079ad649" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:41 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmc5up_ut/privsep.sock'] Sep 23 00:11:41 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmc5up_ut/privsep.sock Sep 23 00:11:41 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:11:42 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:11:42 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:42 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Spawned new privsep daemon via rootwrap Sep 23 00:11:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Accepted privsep connection to /tmp/tmpmc5up_ut/privsep.sock {{(pid=86731) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:11:42 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:11:42 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:11:42 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:11:42 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87751 Sep 23 00:11:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c45278-7bb9-4fb1-9f52-ab193339989c]: (2,) {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b595d-ac6e-4c6e-b96e-e81781afe276]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 Sep 23 00:11:43 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649" returned: 0 in 0.596s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649 Sep 23 00:11:43 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e96ae984-28e2-4de4-929b-ceb6079ad649" returned: 0 in 0.349s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "cinder-quobyte-e96ae984-28e2-4de4-929b-ceb6079ad649" released by "delete_volume" :: held 2.441s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:43 devstack cinder-volume[86731]: WARNING cinder.quota [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:43 devstack cinder-volume[86731]: WARNING cinder.quota [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG cinder.quota [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Created reservations ['c5077dc6-acdb-4cbc-a860-3ea4c4c1854e', 'ee0bb0fe-ec04-4817-b122-1c17c8bf162e', 'fa30e91f-90b7-44e1-aaa7-8d82536aecd1', 'b9f73a1b-4c53-429d-b075-50a2b89a3b82', '8399f6a7-041e-41ed-bb34-b385855288c3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:44 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:11:44 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:44 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG cinder.manager [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Deleted volume successfully. Sep 23 00:11:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-76890e03-b1d1-482c-aa1a-4dfbd97c90ec req-f6340fe5-c85c-4500-966a-fe2c05907726 tempest-VolumesGetTestJSON-1680560228 None] Lock "cinder-e96ae984-28e2-4de4-929b-ceb6079ad649-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:54 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:54 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Flow 'volume_create_manager' (648cb145-02fc-4fa7-82a2-bf6dc2908f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a574549d-98bc-46d0-aad6-b717afcde7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a574549d-98bc-46d0-aad6-b717afcde7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-396021349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e19da-42dc-43a4-bf18-9966ab11e6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0a425a33d94edf9d73ddbff91203a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:34Z,use_quota=True,user_id='37ffcb65b3c748c7a21dff3409fb3815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e40a5aa-5b5c-4b59-b8de-49d794115ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e40a5aa-5b5c-4b59-b8de-49d794115ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef33db-3270-46be-bc90-77e4e29c8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef33db-3270-46be-bc90-77e4e29c8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0e19da-42dc-43a4-bf18-9966ab11e6a8', 'volume_name': 'volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93654f42-9cad-4ca5-9774-f41aa5c6d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93654f42-9cad-4ca5-9774-f41aa5c6d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b54e33e-fa5e-495b-9840-3289c361d2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Volume 2e0e19da-42dc-43a4-bf18-9966ab11e6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8', 'volume_size': 1} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-396021349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e19da-42dc-43a4-bf18-9966ab11e6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0a425a33d94edf9d73ddbff91203a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:34Z,use_quota=True,user_id='37ffcb65b3c748c7a21dff3409fb3815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Creating volume 2e0e19da-42dc-43a4-bf18-9966ab11e6a8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:12:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:33 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 1073741824 Sep 23 00:12:33 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:34 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 1073741824" returned: 0 in 0.751s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:34 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 Sep 23 00:12:34 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:35 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b54e33e-fa5e-495b-9840-3289c361d2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54048e59-7889-4d65-9977-126404d9e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Volume volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 (2e0e19da-42dc-43a4-bf18-9966ab11e6a8): created successfully Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54048e59-7889-4d65-9977-126404d9e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Flow 'volume_create_manager' (648cb145-02fc-4fa7-82a2-bf6dc2908f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-020e8cd0-97aa-4841-9102-1d567406cc15 tempest-TaggedAttachmentsTest-872130253 None] Created volume successfully. Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:37 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:12:37 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:37 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Flow 'volume_create_manager' (e26c1725-415f-4532-a678-61b3dd57656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56024c7d-d7f4-4a63-a28a-94d8286d5ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56024c7d-d7f4-4a63-a28a-94d8286d5ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1155581496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c87edb-bb5f-4286-be5d-1b9a1059c27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fa7f2c17de4e8cb3c06c351b9dd16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:19Z,use_quota=True,user_id='656f6c59c05c4c85a2fbf65a5aeeca1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba35790-d48c-4eda-9192-9d78ec6abd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba35790-d48c-4eda-9192-9d78ec6abd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35fbd49-0396-4424-b937-380bd50dc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35fbd49-0396-4424-b937-380bd50dc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'volume_name': 'volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71888c5c-a200-4169-89c2-2dc905034823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71888c5c-a200-4169-89c2-2dc905034823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68f607b-5a21-4a0f-b105-7b038abf2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Volume 38c87edb-bb5f-4286-be5d-1b9a1059c27d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'volume_size': 1} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1155581496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c87edb-bb5f-4286-be5d-1b9a1059c27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fa7f2c17de4e8cb3c06c351b9dd16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:19Z,use_quota=True,user_id='656f6c59c05c4c85a2fbf65a5aeeca1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Creating volume 38c87edb-bb5f-4286-be5d-1b9a1059c27d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:13:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:19 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d 1073741824 Sep 23 00:13:19 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:19 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d 1073741824" returned: 0 in 0.962s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:20 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d Sep 23 00:13:20 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:20 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d" returned: 0 in 0.581s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68f607b-5a21-4a0f-b105-7b038abf2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadf761d-2e0f-4491-b588-87bbf1ad0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Volume volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d (38c87edb-bb5f-4286-be5d-1b9a1059c27d): created successfully Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadf761d-2e0f-4491-b588-87bbf1ad0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Flow 'volume_create_manager' (e26c1725-415f-4532-a678-61b3dd57656c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-01c68e72-0826-42a7-8ec3-c998eeb1c3f1 tempest-ServerActionsTestOtherA-1197368108 None] Created volume successfully. Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Flow 'volume_create_manager' (5197c9fc-64a6-4870-a671-0869aacbfacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ddd115-4c49-45d6-8572-56dc7998e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ddd115-4c49-45d6-8572-56dc7998e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-431173922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38a5af54a944aca48ddde177376e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:23Z,use_quota=True,user_id='e52f6a7f86da4124821ccdc44083e58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7022ce6a-769a-489f-bf48-acca027fddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7022ce6a-769a-489f-bf48-acca027fddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669b6a5e-f4a4-4eca-8a2d-6f5b85398d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669b6a5e-f4a4-4eca-8a2d-6f5b85398d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00', 'volume_name': 'volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1289265-16b6-44c3-8276-c3835c481fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1289265-16b6-44c3-8276-c3835c481fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29531483-d840-4dd8-a725-2a19b70e3007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Volume aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00', 'volume_size': 1} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-431173922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38a5af54a944aca48ddde177376e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:23Z,use_quota=True,user_id='e52f6a7f86da4124821ccdc44083e58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Creating volume aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:22 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:13:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:22 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 1073741824 Sep 23 00:13:22 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:23 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 1073741824" returned: 0 in 0.786s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:23 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 Sep 23 00:13:23 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:24 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29531483-d840-4dd8-a725-2a19b70e3007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa1e33a-e24a-4c76-9210-4af44ebfbd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Volume volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 (aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00): created successfully Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa1e33a-e24a-4c76-9210-4af44ebfbd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Flow 'volume_create_manager' (5197c9fc-64a6-4870-a671-0869aacbfacb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b9d19d7b-d671-44b7-8f71-6955809e9a9c tempest-AbsoluteLimitsTests-1658031890 None] Created volume successfully. Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Acquiring lock "cinder-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "cinder-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Acquiring lock "cinder-quobyte-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "cinder-quobyte-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc49cbf-523a-4137-90cd-a46c1514bc67]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:25 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 Sep 23 00:13:25 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:26 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" returned: 0 in 0.795s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:26 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00 Sep 23 00:13:26 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:26 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "cinder-quobyte-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00" released by "delete_volume" :: held 1.397s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Created reservations ['5e6b948a-6bed-4c0d-988f-80cf0483dfee', 'bcf6de63-46f5-474c-8334-8411c4da1f37', '4e891311-cef4-454b-8d24-71c906896bd2', 'cfacb28a-b458-4604-9878-4fdcfb737b81', '6c910ed8-a30f-4c28-a603-03eb7c6b9712'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:27 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:13:27 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:27 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.648s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Deleted volume successfully. Sep 23 00:13:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa82243a-07cc-4bf4-9fbd-4abe79ee3502 tempest-AbsoluteLimitsTests-1658031890 None] Lock "cinder-aefd5a3c-7a48-4f9e-96a4-abf1f3af9a00-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:37 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:13:37 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:37 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 8 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:13:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Flow 'volume_create_manager' (2804e1a8-cd18-43a7-87bd-f8e4e2cf0bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49620e1-10d7-4250-a5fc-a892b69ae02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49620e1-10d7-4250-a5fc-a892b69ae02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-965882261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7ea9d0-d9e4-4589-92b2-badde1790e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c755b55c0b7c4ff1b326a600a9481a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:41Z,use_quota=True,user_id='7d5b6da8590441f49f9812d2c0547e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7c5b3e-1e8d-49b9-9502-06b317b7497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7c5b3e-1e8d-49b9-9502-06b317b7497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9d639-9b8e-4ec4-82ab-5b761600851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b9d639-9b8e-4ec4-82ab-5b761600851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7ea9d0-d9e4-4589-92b2-badde1790e7a', 'volume_name': 'volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa898b-6603-44f0-b30a-3c489c38a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aa898b-6603-44f0-b30a-3c489c38a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ac065b-7db4-4629-8b12-8642cf816cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Volume 2e7ea9d0-d9e4-4589-92b2-badde1790e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a', 'volume_size': 1} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-965882261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7ea9d0-d9e4-4589-92b2-badde1790e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c755b55c0b7c4ff1b326a600a9481a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:41Z,use_quota=True,user_id='7d5b6da8590441f49f9812d2c0547e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Creating volume 2e7ea9d0-d9e4-4589-92b2-badde1790e7a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:41 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:13:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:41 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a 1073741824 Sep 23 00:13:41 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:42 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a 1073741824" returned: 0 in 0.869s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:42 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a Sep 23 00:13:42 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:42 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ac065b-7db4-4629-8b12-8642cf816cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6068febe-c92c-4b8d-8f7c-d0bd9cac2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Volume volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a (2e7ea9d0-d9e4-4589-92b2-badde1790e7a): created successfully Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6068febe-c92c-4b8d-8f7c-d0bd9cac2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Flow 'volume_create_manager' (2804e1a8-cd18-43a7-87bd-f8e4e2cf0bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dfd5b317-050b-494c-9c7c-133e9fe334da tempest-VolumesTransfersTest-790832767 None] Created volume successfully. Sep 23 00:13:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-47cde350-12cd-48fd-bc5c-8fff28972e9d tempest-VolumesTransfersTest-277716322 None] Transfer volume completed successfully. Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "cinder-2e7ea9d0-d9e4-4589-92b2-badde1790e7a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-2e7ea9d0-d9e4-4589-92b2-badde1790e7a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "cinder-quobyte-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-quobyte-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7bbf9c-7e95-40b2-a38a-5e1252e0ff2b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:47 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a Sep 23 00:13:47 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:47 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" returned: 0 in 0.726s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:47 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a Sep 23 00:13:47 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:47 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-quobyte-2e7ea9d0-d9e4-4589-92b2-badde1790e7a" released by "delete_volume" :: held 1.248s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Created reservations ['314a428f-79ae-4c10-b26a-0cf56051fea7', 'e5a34cf4-65d8-4c74-8fa7-d38e5e1288dc', 'efc28d2c-f280-4b45-bafb-f7916664b6cd', '295c3f02-9b19-4427-9f12-e6de38d672b9', '6ceb3928-36ba-418d-ae3e-fa8f84abdde7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:48 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:13:48 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:48 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Deleted volume successfully. Sep 23 00:13:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9db5dfc-5e63-4531-a8ac-a2f617888e18 tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-2e7ea9d0-d9e4-4589-92b2-badde1790e7a-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Flow 'volume_create_manager' (11104acd-b066-43ef-8d00-885351ccb921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6da1d5-2adf-430c-8010-c6b5db9d7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6da1d5-2adf-430c-8010-c6b5db9d7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-745327111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35ea46b-04b2-4424-ad64-5998db0957d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c755b55c0b7c4ff1b326a600a9481a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:50Z,use_quota=True,user_id='7d5b6da8590441f49f9812d2c0547e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08d5c1d-bc94-48e2-80ef-80f9847bbfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08d5c1d-bc94-48e2-80ef-80f9847bbfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622110b-1017-4580-8698-9d2e6f763189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c622110b-1017-4580-8698-9d2e6f763189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35ea46b-04b2-4424-ad64-5998db0957d2', 'volume_name': 'volume-a35ea46b-04b2-4424-ad64-5998db0957d2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec7052-d71b-4fcd-a21e-a1656c2607bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec7052-d71b-4fcd-a21e-a1656c2607bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3b9d55-b223-443e-acda-01bbf503dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Volume a35ea46b-04b2-4424-ad64-5998db0957d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35ea46b-04b2-4424-ad64-5998db0957d2', 'volume_size': 1} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-745327111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35ea46b-04b2-4424-ad64-5998db0957d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c755b55c0b7c4ff1b326a600a9481a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:50Z,use_quota=True,user_id='7d5b6da8590441f49f9812d2c0547e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Creating volume a35ea46b-04b2-4424-ad64-5998db0957d2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:13:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:50 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 1073741824 Sep 23 00:13:50 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:51 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 1073741824" returned: 0 in 0.744s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:51 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 Sep 23 00:13:51 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:51 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3b9d55-b223-443e-acda-01bbf503dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35ea46b-04b2-4424-ad64-5998db0957d2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c14ef89-f47a-4ac4-ba8d-cb54e347535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Volume volume-a35ea46b-04b2-4424-ad64-5998db0957d2 (a35ea46b-04b2-4424-ad64-5998db0957d2): created successfully Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c14ef89-f47a-4ac4-ba8d-cb54e347535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Flow 'volume_create_manager' (11104acd-b066-43ef-8d00-885351ccb921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ffb1c2bd-eeb6-4797-a21e-cd911984404d tempest-VolumesTransfersTest-790832767 None] Created volume successfully. Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "cinder-a35ea46b-04b2-4424-ad64-5998db0957d2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-a35ea46b-04b2-4424-ad64-5998db0957d2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "cinder-quobyte-a35ea46b-04b2-4424-ad64-5998db0957d2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-quobyte-a35ea46b-04b2-4424-ad64-5998db0957d2" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebef089-d9de-495f-a3de-7833e6bd41b5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:53 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 Sep 23 00:13:53 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:54 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2" returned: 0 in 0.557s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2 Sep 23 00:13:54 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:54 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a35ea46b-04b2-4424-ad64-5998db0957d2" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-quobyte-a35ea46b-04b2-4424-ad64-5998db0957d2" released by "delete_volume" :: held 0.979s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Created reservations ['025193d7-b418-45d9-b3d3-40adb512e659', '500293af-cc19-45a1-a85b-017c6adf81bc', '51ef3c5e-910e-42e2-92e2-87e3536c611a', '75b08d53-5d39-4017-917a-b31f04d9d4ec', '33c45aaa-3a25-4a8f-8283-f676c9ace286'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:13:54 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:55 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Deleted volume successfully. Sep 23 00:13:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-331aaad5-f184-4f10-91e0-b31c295c0bad tempest-VolumesTransfersTest-1267753634 None] Lock "cinder-a35ea46b-04b2-4424-ad64-5998db0957d2-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:57 devstack cinder-volume[86731]: WARNING py.warnings [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] /opt/stack/cinder/cinder/db/api.py:2747: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 23 00:13:57 devstack cinder-volume[86731]: .first() Sep 23 00:13:57 devstack cinder-volume[86731]: Sep 23 00:13:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37eb8896-8c16-41b5-b490-01d9680ecf02', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:13:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d4a65e36-5314-4cfb-986f-a02090998703 req-9d467c43-96cc-4848-8106-44263854dfcd tempest-TaggedAttachmentsTest-872130253 None] attachment_update completed successfully. Sep 23 00:14:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-79da1c99-5ae0-4666-9e34-ba29ca05b082 req-d17ed2db-e798-459d-8db3-86e7166f9dfa tempest-TaggedAttachmentsTest-872130253 None] Terminate volume connection completed successfully. Sep 23 00:14:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-79da1c99-5ae0-4666-9e34-ba29ca05b082 req-d17ed2db-e798-459d-8db3-86e7166f9dfa tempest-TaggedAttachmentsTest-872130253 None] Deleting attachment 37eb8896-8c16-41b5-b490-01d9680ecf02. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:07 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=22,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c4e8e406-d13a-49e8-bc18-e0aec54396e1 req-b20ee41f-09ca-44c9-9764-6ac5696e0ca8 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c4e8e406-d13a-49e8-bc18-e0aec54396e1 req-b20ee41f-09ca-44c9-9764-6ac5696e0ca8 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c4e8e406-d13a-49e8-bc18-e0aec54396e1 req-b20ee41f-09ca-44c9-9764-6ac5696e0ca8 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-c4e8e406-d13a-49e8-bc18-e0aec54396e1 req-b20ee41f-09ca-44c9-9764-6ac5696e0ca8 tempest-ServerActionsTestOtherA-1197368108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97ac1be1-0f37-438a-b373-6aa7532ff180', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-c4e8e406-d13a-49e8-bc18-e0aec54396e1 req-b20ee41f-09ca-44c9-9764-6ac5696e0ca8 tempest-ServerActionsTestOtherA-1197368108 None] attachment_update completed successfully. Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Flow 'volume_create_manager' (718e1a15-5c24-4f4d-b86b-4e659e23a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629993c7-3b37-4a8e-b2fe-f140435544ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629993c7-3b37-4a8e-b2fe-f140435544ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1280636748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811f86ed-976a-4108-b4f5-da88ba1727a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f5a5a8087a4aecbfa5853ee6b7b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:12Z,use_quota=True,user_id='8a5e5bd9d4c246178420d823becdcedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba5908d-8d8a-4104-b9a9-f1339a6d9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba5908d-8d8a-4104-b9a9-f1339a6d9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577cdb5-d273-405a-96fd-ac3942f9f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7577cdb5-d273-405a-96fd-ac3942f9f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811f86ed-976a-4108-b4f5-da88ba1727a5', 'volume_name': 'volume-811f86ed-976a-4108-b4f5-da88ba1727a5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5616da32-5d55-4d99-b4b7-5a018b59e368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5616da32-5d55-4d99-b4b7-5a018b59e368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab36ab80-5efd-40e8-acaa-acc5481fe99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:12 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Volume 811f86ed-976a-4108-b4f5-da88ba1727a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811f86ed-976a-4108-b4f5-da88ba1727a5', 'volume_size': 1} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1280636748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811f86ed-976a-4108-b4f5-da88ba1727a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f5a5a8087a4aecbfa5853ee6b7b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:12Z,use_quota=True,user_id='8a5e5bd9d4c246178420d823becdcedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Creating volume 811f86ed-976a-4108-b4f5-da88ba1727a5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:12 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:14:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:12 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 1073741824 Sep 23 00:14:12 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:13 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 1073741824" returned: 0 in 1.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:13 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 Sep 23 00:14:13 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:14 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5" returned: 0 in 0.713s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab36ab80-5efd-40e8-acaa-acc5481fe99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811f86ed-976a-4108-b4f5-da88ba1727a5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ab1b0e-2908-435a-91d0-eacf4cf88f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Volume volume-811f86ed-976a-4108-b4f5-da88ba1727a5 (811f86ed-976a-4108-b4f5-da88ba1727a5): created successfully Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ab1b0e-2908-435a-91d0-eacf4cf88f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Flow 'volume_create_manager' (718e1a15-5c24-4f4d-b86b-4e659e23a71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c47b760a-9a78-4b50-8155-291b02670c0c tempest-VolumesTransfersV357Test-1183090271 None] Created volume successfully. Sep 23 00:14:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-491e0aad-0fdb-4112-bcd2-9a503def8ca2 tempest-ServerActionsTestOtherA-1197368108 None] Terminate volume connection completed successfully. Sep 23 00:14:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-491e0aad-0fdb-4112-bcd2-9a503def8ca2 tempest-ServerActionsTestOtherA-1197368108 None] Deleting attachment 97ac1be1-0f37-438a-b373-6aa7532ff180. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c45dbc8e-4b78-4783-a337-a71f075a5963 tempest-VolumesTransfersV357Test-1722400036 None] Transfer volume completed successfully. Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Flow 'volume_create_manager' (9cbbf94f-b2f3-4913-9f53-01faa4e9bee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f25534-a4c2-4817-a177-0f81531c5e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f25534-a4c2-4817-a177-0f81531c5e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2113613861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0270d2-226b-4be3-b31d-6021288ab1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2635ff4b7a642d0b28c94c4b49913d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:19Z,use_quota=True,user_id='03c36440afb141d8beda618cd4e3255a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa4c011-7eae-4b67-a3ee-e71a4be56efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa4c011-7eae-4b67-a3ee-e71a4be56efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b982b88-a9ff-444a-aab3-21594d6ee22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b982b88-a9ff-444a-aab3-21594d6ee22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0270d2-226b-4be3-b31d-6021288ab1f3', 'volume_name': 'volume-bf0270d2-226b-4be3-b31d-6021288ab1f3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85921a9-825b-467b-b44a-c3c13baf0bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85921a9-825b-467b-b44a-c3c13baf0bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ef11af-6ec7-44d5-b0f0-f09ad276beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Volume bf0270d2-226b-4be3-b31d-6021288ab1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0270d2-226b-4be3-b31d-6021288ab1f3', 'volume_size': 1} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2113613861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0270d2-226b-4be3-b31d-6021288ab1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2635ff4b7a642d0b28c94c4b49913d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:19Z,use_quota=True,user_id='03c36440afb141d8beda618cd4e3255a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Creating volume bf0270d2-226b-4be3-b31d-6021288ab1f3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:19 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:19 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 1073741824 Sep 23 00:14:19 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-81751bda-038b-422c-ba4a-7a56963c352c tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "cinder-811f86ed-976a-4108-b4f5-da88ba1727a5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-811f86ed-976a-4108-b4f5-da88ba1727a5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "cinder-quobyte-811f86ed-976a-4108-b4f5-da88ba1727a5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-quobyte-811f86ed-976a-4108-b4f5-da88ba1727a5" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53da37b-b0cf-4935-9491-78157743b44f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:19 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 Sep 23 00:14:19 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 1073741824" returned: 0 in 1.017s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5" returned: 0 in 0.625s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:20 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5 Sep 23 00:14:20 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:20 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 Sep 23 00:14:20 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "cinder-2e0e19da-42dc-43a4-bf18-9966ab11e6a8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "cinder-2e0e19da-42dc-43a4-bf18-9966ab11e6a8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "cinder-quobyte-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "cinder-quobyte-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:20 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-811f86ed-976a-4108-b4f5-da88ba1727a5" returned: 0 in 0.531s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[433911ca-9ddc-4c03-ba8c-5c06b13df9f4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-quobyte-811f86ed-976a-4108-b4f5-da88ba1727a5" released by "delete_volume" :: held 1.266s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:20 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3" returned: 0 in 0.574s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:20 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 Sep 23 00:14:20 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-81751bda-038b-422c-ba4a-7a56963c352c tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.698s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Created reservations ['0644baa0-d51b-4cf6-a612-f8789783d8e2', '6bcafbbe-e6a5-4bd7-a5b9-f7a2375e64f1', 'cac34fc1-89dc-4675-b98d-d9f1eb1b4c45', '9d20b30b-5339-4229-86a4-7329ad93c6ee', '67edcf5f-a69a-4432-af90-f1c47c8a0ff9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ef11af-6ec7-44d5-b0f0-f09ad276beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0270d2-226b-4be3-b31d-6021288ab1f3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d53701-8aeb-4284-8d36-73ed3cce2d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Volume volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 (bf0270d2-226b-4be3-b31d-6021288ab1f3): created successfully Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d53701-8aeb-4284-8d36-73ed3cce2d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Flow 'volume_create_manager' (9cbbf94f-b2f3-4913-9f53-01faa4e9bee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-81751bda-038b-422c-ba4a-7a56963c352c tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.205s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-21db1754-95a4-49cd-ae71-de01f990d738 tempest-VolumesAdminNegativeTest-108729061 None] Created volume successfully. Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-81751bda-038b-422c-ba4a-7a56963c352c tempest-ServerActionsTestOtherA-1197368108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74bff4ca-fc02-4025-975d-013915fa63ff', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:21 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" returned: 0 in 0.526s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:21 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:14:21 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:21 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8 Sep 23 00:14:21 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-a68718d0-68e4-4154-aeeb-0db8e3f5e14b req-81751bda-038b-422c-ba4a-7a56963c352c tempest-ServerActionsTestOtherA-1197368108 None] attachment_update completed successfully. Sep 23 00:14:21 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "cinder-quobyte-2e0e19da-42dc-43a4-bf18-9966ab11e6a8" released by "delete_volume" :: held 1.072s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:21 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.557s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Deleted volume successfully. Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Created reservations ['471ee248-46a5-4981-9f77-27c2cce58e10', '75c199db-6b10-4dca-945f-6d06eb43aa60', '61a51ed1-6951-412a-860a-1b6953c8f68d', 'd001bfc9-a0b3-4dcb-ad54-bca310b712c8', '673c9639-fb03-4af9-a24a-c166be27a981'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:14:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2898d542-1381-4736-9b38-9ae3845b880c tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-811f86ed-976a-4108-b4f5-da88ba1727a5-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:22 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:14:22 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:22 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Deleted volume successfully. Sep 23 00:14:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8bd41456-54c0-4a6c-aab2-ac107b25f515 tempest-TaggedAttachmentsTest-872130253 None] Lock "cinder-2e0e19da-42dc-43a4-bf18-9966ab11e6a8-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Flow 'volume_create_manager' (feb7646b-0758-4986-b1cd-9bdd0390480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8affed3-c899-481d-91f8-fe2b4e0aa398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Acquiring lock "cinder-bf0270d2-226b-4be3-b31d-6021288ab1f3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "cinder-bf0270d2-226b-4be3-b31d-6021288ab1f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8affed3-c899-481d-91f8-fe2b4e0aa398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703155782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f5a5a8087a4aecbfa5853ee6b7b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:23Z,use_quota=True,user_id='8a5e5bd9d4c246178420d823becdcedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca956af-2218-4961-8e74-695b89864f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca956af-2218-4961-8e74-695b89864f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0457ce-f7dd-4f69-80b7-2c6cb075f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0457ce-f7dd-4f69-80b7-2c6cb075f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf', 'volume_name': 'volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fa3449-aff6-48ad-8a6b-786a8bc9f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fa3449-aff6-48ad-8a6b-786a8bc9f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5477d42-57ca-49be-8944-4ca24880c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Volume bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf', 'volume_size': 1} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703155782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f5a5a8087a4aecbfa5853ee6b7b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:23Z,use_quota=True,user_id='8a5e5bd9d4c246178420d823becdcedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Creating volume bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:23 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf 1073741824 Sep 23 00:14:23 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Acquiring lock "cinder-quobyte-bf0270d2-226b-4be3-b31d-6021288ab1f3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "cinder-quobyte-bf0270d2-226b-4be3-b31d-6021288ab1f3" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f898dfe-1ce1-4927-ac0d-fd1f61891025]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:24 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 Sep 23 00:14:24 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:24 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf 1073741824" returned: 0 in 1.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:25 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf Sep 23 00:14:25 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:25 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3" returned: 0 in 1.202s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:25 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3 Sep 23 00:14:25 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:25 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5477d42-57ca-49be-8944-4ca24880c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0c477a-ebd2-4431-8b64-68a35c539b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Volume volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf (bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf): created successfully Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a0c477a-ebd2-4431-8b64-68a35c539b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Flow 'volume_create_manager' (feb7646b-0758-4986-b1cd-9bdd0390480c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fba9bfec-a562-489a-9381-a5e8f4d080a4 tempest-VolumesTransfersV357Test-1183090271 None] Created volume successfully. Sep 23 00:14:25 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bf0270d2-226b-4be3-b31d-6021288ab1f3" returned: 0 in 0.713s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "cinder-quobyte-bf0270d2-226b-4be3-b31d-6021288ab1f3" released by "delete_volume" :: held 2.065s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Created reservations ['12e5d77f-2134-4478-ae09-783128dcc424', 'd4f6e17a-fa57-4123-b996-c86350ba838f', '7fc1a5ba-291f-44a9-87a2-e10401b08392', '6dbd42d4-1a1b-472b-a374-307f25ff381e', '28a5fb26-db9e-4610-89c7-f2647d8faa03'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:26 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:14:26 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:26 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Deleted volume successfully. Sep 23 00:14:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db830ef6-4767-4667-a2c2-7a223c49acd3 tempest-VolumesAdminNegativeTest-108729061 None] Lock "cinder-bf0270d2-226b-4be3-b31d-6021288ab1f3-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "cinder-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "cinder-quobyte-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-quobyte-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f314601a-8c43-4a18-9c43-b89fd80bedf2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:28 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf Sep 23 00:14:28 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:28 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:29 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf Sep 23 00:14:29 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:29 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-quobyte-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf" released by "delete_volume" :: held 1.345s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Created reservations ['d8d39167-7b44-422c-945a-4068fcf6dab7', '0ae2a8e1-fbab-4c9e-957b-ff0b796a68b6', 'ed0d9fab-67b8-49f1-9d60-8d7bf95e07b5', '22182860-e4e8-424d-89bf-415a1db1a5e0', '773ded5a-61fa-4d42-ba6b-2c1ddeeb4e86'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:29 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:14:29 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:30 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Deleted volume successfully. Sep 23 00:14:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb01bc50-1b03-433d-9e90-f5ecfd1bc379 tempest-VolumesTransfersV357Test-794373881 None] Lock "cinder-bcff2029-6bc8-4937-9f7f-1c58fc4b9ebf-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:37 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:14:37 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:37 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 8 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:39 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=38,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=75,cinder:UPDATE=82,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Flow 'volume_create_manager' (e894101b-81e5-437b-bdcb-c1a1d59eb8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeec9c35-7898-48f0-b798-1b00ba899936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeec9c35-7898-48f0-b798-1b00ba899936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1543204516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0e9db111c94d2cafe65c2c655e68f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='6f6687f0ac9e4e84a6a6f0f41cda5c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1aead53-6ab6-4397-96b6-cb5e42929d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1aead53-6ab6-4397-96b6-cb5e42929d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a8aef1-52ca-4c98-8420-35248cb69d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a8aef1-52ca-4c98-8420-35248cb69d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'volume_name': 'volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba778e88-98fe-441a-abed-6c6c004495b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba778e88-98fe-441a-abed-6c6c004495b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567126c-c327-4d59-8127-e2734f4e27ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Volume 6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'volume_size': 1} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1543204516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0e9db111c94d2cafe65c2c655e68f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='6f6687f0ac9e4e84a6a6f0f41cda5c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Creating volume 6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:44 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:14:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d 1073741824 Sep 23 00:14:44 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d 1073741824" returned: 0 in 0.583s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:14:45 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567126c-c327-4d59-8127-e2734f4e27ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e6d537-4fcd-4400-ac7c-35b24e2b43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Volume volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d (6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d): created successfully Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e6d537-4fcd-4400-ac7c-35b24e2b43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Flow 'volume_create_manager' (e894101b-81e5-437b-bdcb-c1a1d59eb8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e3122104-f432-44ca-9352-ddaed05f7d73 tempest-VolumesCloneTest-1783142052 None] Created volume successfully. Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Flow 'volume_create_manager' (c45adb7d-06af-4479-8ac2-af27cee01a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb33c40-a45a-4c3a-8535-fc2f1e230d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb33c40-a45a-4c3a-8535-fc2f1e230d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-530903454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b278711b-88fc-460d-92a2-9044bced84d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0e9db111c94d2cafe65c2c655e68f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:47Z,use_quota=True,user_id='6f6687f0ac9e4e84a6a6f0f41cda5c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c86c833-130d-4fb9-8ef8-15d50a74f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c86c833-130d-4fb9-8ef8-15d50a74f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4913c189-01e4-441f-96b3-d1d222b02d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4913c189-01e4-441f-96b3-d1d222b02d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b278711b-88fc-460d-92a2-9044bced84d6', 'volume_name': 'volume-b278711b-88fc-460d-92a2-9044bced84d6', 'volume_size': 2, 'source_volid': '6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91349840-d873-4496-9611-3908bd6a5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91349840-d873-4496-9611-3908bd6a5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938687d-674c-4570-851f-8c490ff83cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Volume b278711b-88fc-460d-92a2-9044bced84d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b278711b-88fc-460d-92a2-9044bced84d6', 'volume_size': 2, 'source_volid': '6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'source_volstatus': 'available'} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Cloning volume 6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d to volume b278711b-88fc-460d-92a2-9044bced84d6 Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Creating offline snapshot 3b816e20-9beb-4e66-80bb-8ea11c5ea7ff of volume 6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f38ef-db90-46ad-ab61-0e435c148e26]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:47 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:14:47 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:48 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:48 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff 1G Sep 23 00:14:48 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:48 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff 1G" returned: 0 in 0.627s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:48 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:14:48 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fe1ced44-2e67-4601-8d72-418de88152d7 tempest-BackendsCapabilitiesAdminTestsJSON-1582831904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:14:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-451d3422-16ab-4038-91a5-a1ecf840c6a5 tempest-BackendsCapabilitiesAdminTestsJSON-1582831904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:14:49 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff is being set with open permissions: ugo+rw Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:14:49 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:49 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:49 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info Sep 23 00:14:49 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:49 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info is being set with open permissions: ugo+rw Sep 23 00:14:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:50 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info Sep 23 00:14:50 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:50 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.info" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] snapshot: 3b816e20-9beb-4e66-80bb-8ea11c5ea7ff, volume: b278711b-88fc-460d-92a2-9044bced84d6, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeecf7e1-b555-45ef-b6ed-e8110210cfb6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:50 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:14:50 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.723s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f4c6c-7cf5-47c8-965e-c88ea610a515]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:14:51 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.560s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:14:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 Sep 23 00:14:51 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-bc605e84-197e-4b31-8ca1-c144b09ac9a4 req-a1f5f214-ffee-48ee-9c80-3b49c45be584 tempest-ServerActionsTestOtherA-1197368108 None] Terminate volume connection completed successfully. Sep 23 00:14:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bc605e84-197e-4b31-8ca1-c144b09ac9a4 req-a1f5f214-ffee-48ee-9c80-3b49c45be584 tempest-ServerActionsTestOtherA-1197368108 None] Deleting attachment 74bff4ca-fc02-4025-975d-013915fa63ff. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:02 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6" returned: 0 in 10.897s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:02 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d, size 1024.00 MB, duration 10.90 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:02 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Converted 1024.00 MB image at 93.95 MB/s Sep 23 00:15:02 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 is being set with open permissions: ugo+rw Sep 23 00:15:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 Sep 23 00:15:02 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6" returned: 0 in 0.564s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" released by "_copy_volume_from_snapshot" :: held 12.869s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-quobyte-3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Deleting offline snapshot 3b816e20-9beb-4e66-80bb-8ea11c5ea7ff of volume 6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] snapshot_file for this snap is: volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3588a6ea-7f5a-44cb-9af3-4a059c3125ee]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:03 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:15:03 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c953a209-024c-434b-83fc-876405db49c9 tempest-GroupSnapshotsV319Test-1288262420 None] Group tempest-GroupSnapshotsV319Test-Group-9746606: creating Sep 23 00:15:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c953a209-024c-434b-83fc-876405db49c9 tempest-GroupSnapshotsV319Test-1288262420 None] Group tempest-GroupSnapshotsV319Test-Group-9746606: created successfully Sep 23 00:15:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c953a209-024c-434b-83fc-876405db49c9 tempest-GroupSnapshotsV319Test-1288262420 None] Create group completed successfully. Sep 23 00:15:03 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf3b3f8-6820-49bc-9e1a-3b1959d805bf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:15:04 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:04 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.649s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:04 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:15:04 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:05 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff Sep 23 00:15:05 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:05 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d.3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-3b816e20-9beb-4e66-80bb-8ea11c5ea7ff" released by "_delete_snapshot" :: held 2.203s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.251s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938687d-674c-4570-851f-8c490ff83cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b278711b-88fc-460d-92a2-9044bced84d6', 'volume_size': 2, 'source_volid': '6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778678d-fd03-48c9-b50c-4a29b19f98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Volume volume-b278711b-88fc-460d-92a2-9044bced84d6 (b278711b-88fc-460d-92a2-9044bced84d6): created successfully Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778678d-fd03-48c9-b50c-4a29b19f98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Flow 'volume_create_manager' (c45adb7d-06af-4479-8ac2-af27cee01a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2db2849e-0611-4058-9fd2-71a428c2c324 tempest-VolumesCloneTest-1783142052 None] Created volume successfully. Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Flow 'volume_create_manager' (893ac872-7f8c-4476-aae1-ed0be29b1135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d9a9d0-0122-4b5e-9d7f-4adc5d29ddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d9a9d0-0122-4b5e-9d7f-4adc5d29ddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705161561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33cba40b-07c8-4c4d-af3c-de211c69d0a9,host='devstack@QuobyteHD#QuobyteHD',id=43a9b880-fde2-4fb1-8fa2-42149f556bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a61dd69cf7446da64de521c5db86b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:06Z,use_quota=True,user_id='4d26759e130a4a2999b5e298ac71ae3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce8b82c-38f5-4566-84bd-7044e8e29592),volume_type_id=9ce8b82c-38f5-4566-84bd-7044e8e29592)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e930948a-1074-46d3-839c-b0a0a5641450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e930948a-1074-46d3-839c-b0a0a5641450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c84cdd-2a72-4660-8307-dc805b9fb61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c84cdd-2a72-4660-8307-dc805b9fb61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a9b880-fde2-4fb1-8fa2-42149f556bc6', 'volume_name': 'volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae701ea4-491d-473e-b1f8-414d7ce5f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae701ea4-491d-473e-b1f8-414d7ce5f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c5d64-1c1f-4ac9-9cca-219e7a84f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Volume 43a9b880-fde2-4fb1-8fa2-42149f556bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6', 'volume_size': 1} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33cba40b-07c8-4c4d-af3c-de211c69d0a9,created_at=2026-09-22T22:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-705161561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33cba40b-07c8-4c4d-af3c-de211c69d0a9,host='devstack@QuobyteHD#QuobyteHD',id=43a9b880-fde2-4fb1-8fa2-42149f556bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a61dd69cf7446da64de521c5db86b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:06Z,use_quota=True,user_id='4d26759e130a4a2999b5e298ac71ae3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ce8b82c-38f5-4566-84bd-7044e8e29592),volume_type_id=9ce8b82c-38f5-4566-84bd-7044e8e29592)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Creating volume 43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:05 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 1073741824 Sep 23 00:15:05 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:06 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 1073741824" returned: 0 in 0.769s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:06 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 Sep 23 00:15:06 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:07 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c5d64-1c1f-4ac9-9cca-219e7a84f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b23dc1-2ea7-415c-a1e8-7af8b4cb046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Volume volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 (43a9b880-fde2-4fb1-8fa2-42149f556bc6): created successfully Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b23dc1-2ea7-415c-a1e8-7af8b4cb046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Flow 'volume_create_manager' (893ac872-7f8c-4476-aae1-ed0be29b1135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-865cac00-aaa8-4402-a4a5-3456431a770c tempest-GroupSnapshotsV319Test-1288262420 None] Created volume successfully. Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-b278711b-88fc-460d-92a2-9044bced84d6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-b278711b-88fc-460d-92a2-9044bced84d6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4283b-aa81-43f9-85ae-8ed45b2102f3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:07 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 Sep 23 00:15:07 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6" returned: 0 in 0.521s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6 Sep 23 00:15:08 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Flow 'volume_create_manager' (a6dbf61a-f5d2-455c-be32-aeff71909ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59955236-76bb-411f-8326-2e04a8845705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59955236-76bb-411f-8326-2e04a8845705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1808242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca547ad-2552-4a5b-96d8-1006dd3063c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fa7f2c17de4e8cb3c06c351b9dd16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:08Z,use_quota=True,user_id='656f6c59c05c4c85a2fbf65a5aeeca1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44926004-5f3a-47fa-ac6c-7e7dd6c84ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44926004-5f3a-47fa-ac6c-7e7dd6c84ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e375cc-8eb6-48ba-85cb-f99da6285981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:15:08 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b278711b-88fc-460d-92a2-9044bced84d6" returned: 0 in 0.361s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-b278711b-88fc-460d-92a2-9044bced84d6" released by "delete_volume" :: held 0.948s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Created reservations ['e22f115f-1418-4467-886a-39d84d1bde59', '720e9973-7880-440a-a47f-f794b1b9d363', 'a4b10a49-8e89-4359-806f-3088f2bf3148', '5cdb8dde-2f54-43d2-90bf-47437970397e', 'ea05327e-5eb7-4fc5-aced-d0abc002aa70'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:08 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:08 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e375cc-8eb6-48ba-85cb-f99da6285981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eca547ad-2552-4a5b-96d8-1006dd3063c8', 'volume_name': 'volume-eca547ad-2552-4a5b-96d8-1006dd3063c8', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7cb574-b870-4331-9fb7-cf0b2938ed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a7cb574-b870-4331-9fb7-cf0b2938ed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b660a92a-b38e-49e6-bab3-a9253c810b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Volume eca547ad-2552-4a5b-96d8-1006dd3063c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eca547ad-2552-4a5b-96d8-1006dd3063c8', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Trying to clone eca547ad-2552-4a5b-96d8-1006dd3063c8 from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:15:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] GroupSnapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: creating. Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Group snapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Creating offline snapshot c5978c46-1d75-450a-846a-cc5886e60f4a of volume 43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:09 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97397d05-ef01-464c-8994-a83602988d0f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Deleted volume successfully. Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21b8a919-715f-4d69-9cad-e8447c4955a4 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-b278711b-88fc-460d-92a2-9044bced84d6-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:09 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 Sep 23 00:15:09 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:15:09 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4ea05-f974-4692-89e3-b90b9da19266]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:09 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD Sep 23 00:15:09 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:09 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6" returned: 0 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a 1G Sep 23 00:15:10 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "cinder-quobyte-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3566f-e808-41fb-bb27-5523e9eadc4b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 is fetched for user 656f6c59c05c4c85a2fbf65a5aeeca1f. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:15:10 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:15:10 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[286fa022-6e71-4b4f-9f40-093046d8d22b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD Sep 23 00:15:10 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:10 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a 1G" returned: 0 in 0.795s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a Sep 23 00:15:10 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:10 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.592s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:10 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d Sep 23 00:15:10 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:11 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a Sep 23 00:15:11 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-quobyte-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d" released by "delete_volume" :: held 1.056s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Created reservations ['846a6eaf-6f4c-4e11-ab12-4106ad203a51', 'b51e4253-14b0-49bc-ae59-b3050d026359', 'd61168eb-c958-4336-8979-638b81fc898f', '9e8abb80-7256-4ddf-ad03-ee2f19d164dd', '04536d26-aeda-4840-b8d8-5a42a0b8690f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:11 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info Sep 23 00:15:11 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:11 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Deleted volume successfully. Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d5a57a69-052d-4609-8783-4791b2e6ca75 tempest-VolumesCloneTest-1783142052 None] Lock "cinder-6d7dda76-e1fd-49bf-a1a7-fe6fbdf4937d-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:11 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:15:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:11 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info Sep 23 00:15:11 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:12 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.info" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1808242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca547ad-2552-4a5b-96d8-1006dd3063c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fa7f2c17de4e8cb3c06c351b9dd16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:08Z,use_quota=True,user_id='656f6c59c05c4c85a2fbf65a5aeeca1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Creating volume eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:12 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:12 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1073741824 Sep 23 00:15:12 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f6d335f1-345a-468d-bad8-344525e4567f tempest-GroupSnapshotsV319Test-1288262420 None] group_snapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: created successfully Sep 23 00:15:13 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1073741824" returned: 0 in 0.813s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:13 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 Sep 23 00:15:13 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:13 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8" returned: 0 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Attempting download of 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume eca547ad-2552-4a5b-96d8-1006dd3063c8. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c1184-fb03-4119-8003-4c3255196f36]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:13 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d Sep 23 00:15:13 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] group_snapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: deleting Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] group_snapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "cinder-quobyte-c5978c46-1d75-450a-846a-cc5886e60f4a" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-c5978c46-1d75-450a-846a-cc5886e60f4a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Deleting offline snapshot c5978c46-1d75-450a-846a-cc5886e60f4a of volume 43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:15:14 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d Sep 23 00:15:14 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] snapshot_file for this snap is: volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[19934d9c-10cf-4297-a9b8-ed67a9bac92f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:14 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a Sep 23 00:15:14 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:14 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d" returned: 1 in 0.682s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_dsk4ns9d' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c780c-e24a-476a-af8b-2d95af94993e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:15 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD Sep 23 00:15:15 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:15 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a" returned: 0 in 0.767s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef39f5e1-cb8f-4110-984a-f33905d1bf66]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:15 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] 0372fb84-b9ec-4156-81ef-452ae7f0ea37 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:15:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:15 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 Sep 23 00:15:15 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:15 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 Sep 23 00:15:15 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6" returned: 0 in 0.664s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a Sep 23 00:15:16 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:16 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:16 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a Sep 23 00:15:16 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:17 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6.c5978c46-1d75-450a-846a-cc5886e60f4a" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-c5978c46-1d75-450a-846a-cc5886e60f4a" released by "_delete_snapshot" :: held 2.602s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" released by "delete_snapshot" :: held 2.654s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-960117681 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-960117681, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-960117681 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-960117681, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] Created reservations ['86608dba-61da-4da4-9d40-2823216c0e0c', '1718e72e-b45e-424f-a799-a6e0b5526f13', 'e2252fee-7e86-4df4-a038-94d9403a662f', 'be2adf4b-7468-4914-a582-4a81a65f33c8', '615dc567-22f4-4123-a604-e214ba217b4e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9fe4f6c-ff59-421a-b66a-0c46e053d5f3 tempest-GroupSnapshotsV319Test-1288262420 None] group_snapshot b3312f6f-ad0d-43e6-9ef8-08dc0a99536d: deleted successfully Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:18 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8" returned: 0 in 3.186s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_v6bbt5uidevstack@QuobyteHD, size 112.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:18 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Converted 112.00 MB image at 35.14 MB/s Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[970100de-a22c-4cc1-a071-07f76b5f4a65]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:18 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1G Sep 23 00:15:18 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:18 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 Sep 23 00:15:18 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:19 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 1G" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Downloaded image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume eca547ad-2552-4a5b-96d8-1006dd3063c8 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 for user 656f6c59c05c4c85a2fbf65a5aeeca1f is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Marking volume eca547ad-2552-4a5b-96d8-1006dd3063c8 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Copying metadata from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 to eca547ad-2552-4a5b-96d8-1006dd3063c8. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Creating volume glance metadata for volume eca547ad-2552-4a5b-96d8-1006dd3063c8 backed by image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (51b468e0-e060-4b5f-84c4-c52bf98e511c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36149d21-0771-449e-9b61-6bb39412f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36149d21-0771-449e-9b61-6bb39412f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-454637770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd6b824-1368-4135-a6a1-b40e6e0b93a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:19Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483b067f-f895-4332-9ecc-64b5c47e7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483b067f-f895-4332-9ecc-64b5c47e7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e824bd-1b96-44cf-b167-aff926b9af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e824bd-1b96-44cf-b167-aff926b9af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efd6b824-1368-4135-a6a1-b40e6e0b93a4', 'volume_name': 'volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc690b6-6959-4145-adbe-3660bc0bb2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc690b6-6959-4145-adbe-3660bc0bb2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d92969-6894-4417-8542-fb3d686a4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Volume efd6b824-1368-4135-a6a1-b40e6e0b93a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4', 'volume_size': 1} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-454637770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd6b824-1368-4135-a6a1-b40e6e0b93a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:19Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Creating volume efd6b824-1368-4135-a6a1-b40e6e0b93a4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:19 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6" returned: 0 in 0.787s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:19 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 1073741824 Sep 23 00:15:19 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:19 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6 Sep 23 00:15:19 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b660a92a-b38e-49e6-bab3-a9253c810b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca547ad-2552-4a5b-96d8-1006dd3063c8', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c7773-fd77-4b0e-9ca5-fa566c5e55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Volume volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 (eca547ad-2552-4a5b-96d8-1006dd3063c8): created successfully Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c7773-fd77-4b0e-9ca5-fa566c5e55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Flow 'volume_create_manager' (a6dbf61a-f5d2-455c-be32-aeff71909ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-40a582ac-9645-4442-b9dc-686feeaaac13 tempest-ServerActionsTestOtherA-1197368108 None] Created volume successfully. Sep 23 00:15:19 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b880-fde2-4fb1-8fa2-42149f556bc6" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "cinder-quobyte-43a9b880-fde2-4fb1-8fa2-42149f556bc6" released by "delete_volume" :: held 1.419s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Created reservations ['41388bff-8909-474e-923b-2cbd0f168256'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:20 devstack cinder-volume[86731]: WARNING cinder.quota [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-960117681 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-960117681, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:20 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Created reservations ['810f3e3a-b432-49e3-bbaf-e94c06eed4d3', '1086daa1-b565-4287-8a30-304af7930610', 'ddd6a256-c4fe-4147-8a85-56f53e11acf6', 'bf49a5cf-a99c-4d59-8def-4dcd33bdb68e', '55eeb962-2699-4495-bd24-ecd6fc52ce90'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 1073741824" returned: 0 in 0.730s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:20 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 Sep 23 00:15:20 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:20 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:20 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:20 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4" returned: 0 in 0.550s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d92969-6894-4417-8542-fb3d686a4095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af66071a-33f8-47a9-9424-62bfa72bf196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:20 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Volume volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 (efd6b824-1368-4135-a6a1-b40e6e0b93a4): created successfully Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af66071a-33f8-47a9-9424-62bfa72bf196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (51b468e0-e060-4b5f-84c4-c52bf98e511c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fc1bfef4-447b-4b30-b6d3-f3b25876ff03 tempest-GroupSnapshotsV319Test-1288262420 None] Delete group completed successfully. Sep 23 00:15:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eb2bdfcb-6b35-4245-9e9b-31473d669575 tempest-VolumesListTestJSON-1737504838 None] Created volume successfully. Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (9832bd44-2c2b-44ee-b84c-7ba1161139a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e237a9ac-f517-41c5-a05c-daec739300d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e237a9ac-f517-41c5-a05c-daec739300d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1686845759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9380e77-bf3d-47a5-bea4-d5f8207ab29b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:22Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1b4bdc-d269-44ce-8d9d-1e240417f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1b4bdc-d269-44ce-8d9d-1e240417f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a8a2f-c686-4fe3-bee2-9fd9204714cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a8a2f-c686-4fe3-bee2-9fd9204714cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9380e77-bf3d-47a5-bea4-d5f8207ab29b', 'volume_name': 'volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9133c6-6f6d-42fe-b4b4-756cd0d72951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9133c6-6f6d-42fe-b4b4-756cd0d72951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248ce0d8-04b6-4732-b3cc-546b8ca9342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Volume a9380e77-bf3d-47a5-bea4-d5f8207ab29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b', 'volume_size': 1} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1686845759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9380e77-bf3d-47a5-bea4-d5f8207ab29b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:22Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Creating volume a9380e77-bf3d-47a5-bea4-d5f8207ab29b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:22 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:22 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b 1073741824 Sep 23 00:15:22 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:23 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b 1073741824" returned: 0 in 0.761s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:23 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b Sep 23 00:15:23 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:23 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" returned: 0 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248ce0d8-04b6-4732-b3cc-546b8ca9342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45199d1d-d763-49e4-afd9-9c4ce913a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Volume volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b (a9380e77-bf3d-47a5-bea4-d5f8207ab29b): created successfully Sep 23 00:15:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45199d1d-d763-49e4-afd9-9c4ce913a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (9832bd44-2c2b-44ee-b84c-7ba1161139a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2ea4242f-8f33-407a-9466-b0263e81d9fd tempest-VolumesListTestJSON-1737504838 None] Created volume successfully. Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-48b705f0-ab30-44e6-822f-ed7b27b9938a req-4ac74b66-828a-477d-9fbc-80ef475a2ed1 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-48b705f0-ab30-44e6-822f-ed7b27b9938a req-4ac74b66-828a-477d-9fbc-80ef475a2ed1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-48b705f0-ab30-44e6-822f-ed7b27b9938a req-4ac74b66-828a-477d-9fbc-80ef475a2ed1 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-48b705f0-ab30-44e6-822f-ed7b27b9938a req-4ac74b66-828a-477d-9fbc-80ef475a2ed1 tempest-ServerActionsTestOtherA-1197368108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-eca547ad-2552-4a5b-96d8-1006dd3063c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e3066a1-3ee0-4b63-ab71-270e56533bf7', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (2dbd808b-907f-4d6b-a1ce-0117bfc0bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8312b6-81da-427c-8c1e-0052db1792f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8312b6-81da-427c-8c1e-0052db1792f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1305088371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e814bf8-730c-444a-846d-6a53ec5675b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:26Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884f6693-d5ad-4e15-831f-2021eb73bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884f6693-d5ad-4e15-831f-2021eb73bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c2f60a-a8f1-42b5-b754-801b607486d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c2f60a-a8f1-42b5-b754-801b607486d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e814bf8-730c-444a-846d-6a53ec5675b5', 'volume_name': 'volume-8e814bf8-730c-444a-846d-6a53ec5675b5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b110d66-a321-4c14-b521-4d6406614db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b110d66-a321-4c14-b521-4d6406614db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83b6028-a39d-40cf-b9d8-e1780c403b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Volume 8e814bf8-730c-444a-846d-6a53ec5675b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e814bf8-730c-444a-846d-6a53ec5675b5', 'volume_size': 1} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1305088371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e814bf8-730c-444a-846d-6a53ec5675b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6afc1f1d8666471a96fc8877dacd1168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:26Z,use_quota=True,user_id='df5f5567095c4de1868c9fadf829059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Creating volume 8e814bf8-730c-444a-846d-6a53ec5675b5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:26 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-48b705f0-ab30-44e6-822f-ed7b27b9938a req-4ac74b66-828a-477d-9fbc-80ef475a2ed1 tempest-ServerActionsTestOtherA-1197368108 None] attachment_update completed successfully. Sep 23 00:15:26 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 1073741824 Sep 23 00:15:26 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:27 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 1073741824" returned: 0 in 0.954s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:27 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 Sep 23 00:15:27 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:27 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83b6028-a39d-40cf-b9d8-e1780c403b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e814bf8-730c-444a-846d-6a53ec5675b5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc39fdb8-8c7e-4d08-bcc6-db02c127a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Volume volume-8e814bf8-730c-444a-846d-6a53ec5675b5 (8e814bf8-730c-444a-846d-6a53ec5675b5): created successfully Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc39fdb8-8c7e-4d08-bcc6-db02c127a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Flow 'volume_create_manager' (2dbd808b-907f-4d6b-a1ce-0117bfc0bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d8e87117-14cb-4783-bc41-5cbb9fe04ecc tempest-VolumesListTestJSON-1737504838 None] Created volume successfully. Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-8e814bf8-730c-444a-846d-6a53ec5675b5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-8e814bf8-730c-444a-846d-6a53ec5675b5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-quobyte-8e814bf8-730c-444a-846d-6a53ec5675b5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-8e814bf8-730c-444a-846d-6a53ec5675b5" acquired by "delete_volume" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[526fb245-e056-42f0-8d19-ca17606982f1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 Sep 23 00:15:33 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:34 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5" returned: 0 in 1.401s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:34 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5 Sep 23 00:15:34 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:35 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8e814bf8-730c-444a-846d-6a53ec5675b5" returned: 0 in 0.803s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-8e814bf8-730c-444a-846d-6a53ec5675b5" released by "delete_volume" :: held 2.305s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Created reservations ['5c9e5d41-d3c0-4fce-b716-81fc099edc61', '36529e82-98fe-4a96-93a7-0b5dbc9c7d27', 'e9567d7a-c2bc-40d5-a32f-308d3c136f6e', '2362b08e-00d8-498b-8da9-5aadb3573bcb', '3d5bfde5-adb2-43a1-8f91-eeed4b74bf4d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:36 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:36 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:37 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:37 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.168s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Deleted volume successfully. Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-a9380e77-bf3d-47a5-bea4-d5f8207ab29b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c8936c2b-48ca-494a-a14b-b6173bcd100e tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-8e814bf8-730c-444a-846d-6a53ec5675b5-delete_volume" released by "delete_volume" :: held 4.729s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-a9380e77-bf3d-47a5-bea4-d5f8207ab29b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-quobyte-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" acquired by "delete_volume" :: waited 0.100s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58f0b2-9e16-417a-b310-6f4420aba4a7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:38 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.196s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:38 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b Sep 23 00:15:38 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:39 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" returned: 0 in 1.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b Sep 23 00:15:39 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" returned: 0 in 0.455s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-a9380e77-bf3d-47a5-bea4-d5f8207ab29b" released by "delete_volume" :: held 2.011s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=77,cinder:UPDATE=75,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Created reservations ['57130da4-8153-490e-94f1-53df6d430783', '95b79231-622d-40b9-b792-dd8034eee9b3', '02567a67-71ec-4ff5-b356-72016438005c', '2939a3be-18c7-4f68-b8cf-d0e55bc477a0', 'c42528d7-c259-46e0-a826-e55549dff430'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=79,cinder:INSERT=33,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:40 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:40 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-efd6b824-1368-4135-a6a1-b40e6e0b93a4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-efd6b824-1368-4135-a6a1-b40e6e0b93a4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "cinder-quobyte-efd6b824-1368-4135-a6a1-b40e6e0b93a4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-efd6b824-1368-4135-a6a1-b40e6e0b93a4" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c22edd-e0fc-422a-8122-28b261a1be07]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:41 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.064s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Deleted volume successfully. Sep 23 00:15:41 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 Sep 23 00:15:41 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d37549c5-e21b-408a-8e56-3f6d678c7580 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-a9380e77-bf3d-47a5-bea4-d5f8207ab29b-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Flow 'volume_create_manager' (0ef21449-819c-4583-a4e1-f5f6a797dca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:42 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09de49-6c79-472f-ab6d-0b0328b3d9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4" returned: 0 in 1.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09de49-6c79-472f-ab6d-0b0328b3d9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1921069320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a9b3fe-158a-42cb-b98e-a3beb330ee7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe643ee1b2024144988ae6b8efb9ad9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:43Z,use_quota=True,user_id='f54ec68b9dea49c0b22c2bce5ed1bba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2ecb53-1759-4aa1-8210-9a7983800e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2ecb53-1759-4aa1-8210-9a7983800e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dac185a-b868-4094-9cef-288f8165296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4 Sep 23 00:15:43 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dac185a-b868-4094-9cef-288f8165296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a9b3fe-158a-42cb-b98e-a3beb330ee7f', 'volume_name': 'volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b85201f-2a28-497d-af5d-dad2ea2c07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b85201f-2a28-497d-af5d-dad2ea2c07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90877828-b558-40c3-92f3-909fc24161c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Volume 43a9b3fe-158a-42cb-b98e-a3beb330ee7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f', 'volume_size': 1} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1921069320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a9b3fe-158a-42cb-b98e-a3beb330ee7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe643ee1b2024144988ae6b8efb9ad9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:43Z,use_quota=True,user_id='f54ec68b9dea49c0b22c2bce5ed1bba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Creating volume 43a9b3fe-158a-42cb-b98e-a3beb330ee7f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f 1073741824 Sep 23 00:15:43 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-efd6b824-1368-4135-a6a1-b40e6e0b93a4" returned: 0 in 0.598s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-quobyte-efd6b824-1368-4135-a6a1-b40e6e0b93a4" released by "delete_volume" :: held 2.197s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Created reservations ['77006ae4-2ccc-451b-aa85-11c410a116d4', '52dbe148-b5ea-4f42-a92d-06020405eb9a', '7fe165c4-3572-4a6c-b3f3-586ce55f5c6a', 'c7153eb7-737d-40c8-809e-7187de9b17b3', '2ecff8be-9838-45f2-b8f5-4ca06695947c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:15:44 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f 1073741824" returned: 0 in 1.560s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f Sep 23 00:15:44 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:45 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.148s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Deleted volume successfully. Sep 23 00:15:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-359fec85-d75d-4b80-96fd-dc62dc217718 tempest-VolumesListTestJSON-1737504838 None] Lock "cinder-efd6b824-1368-4135-a6a1-b40e6e0b93a4-delete_volume" released by "delete_volume" :: held 4.218s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:46 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" returned: 0 in 1.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] <== create_volume: return (3088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.101s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90877828-b558-40c3-92f3-909fc24161c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed79b4f-a1f1-466d-a943-d195e63bb07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Volume volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f (43a9b3fe-158a-42cb-b98e-a3beb330ee7f): created successfully Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed79b4f-a1f1-466d-a943-d195e63bb07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Flow 'volume_create_manager' (0ef21449-819c-4583-a4e1-f5f6a797dca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ee2157f2-b3e8-41b3-a7e4-9aa0fa916f6e tempest-DeleteServersTestJSON-951041124 None] Created volume successfully. Sep 23 00:15:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c1c7026-34e7-44df-b0e4-8042d79f0f75 req-c06bf296-15b7-430f-b494-793c46df0197 tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c1c7026-34e7-44df-b0e4-8042d79f0f75 req-c06bf296-15b7-430f-b494-793c46df0197 tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c1c7026-34e7-44df-b0e4-8042d79f0f75 req-c06bf296-15b7-430f-b494-793c46df0197 tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9c1c7026-34e7-44df-b0e4-8042d79f0f75 req-c06bf296-15b7-430f-b494-793c46df0197 tempest-DeleteServersTestJSON-951041124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e035993-4767-4ff5-bef9-68f3dc642e0b', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9c1c7026-34e7-44df-b0e4-8042d79f0f75 req-c06bf296-15b7-430f-b494-793c46df0197 tempest-DeleteServersTestJSON-951041124 None] attachment_update completed successfully. Sep 23 00:15:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-32750ce8-59ce-4ac1-94d1-eaa8b1fc1383 req-c89ce0f3-3386-4bbc-986a-99c84c2f8164 tempest-DeleteServersTestJSON-951041124 None] Terminate volume connection completed successfully. Sep 23 00:15:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-32750ce8-59ce-4ac1-94d1-eaa8b1fc1383 req-c89ce0f3-3386-4bbc-986a-99c84c2f8164 tempest-DeleteServersTestJSON-951041124 None] Deleting attachment 5e035993-4767-4ff5-bef9-68f3dc642e0b. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "cinder-43a9b3fe-158a-42cb-b98e-a3beb330ee7f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "cinder-43a9b3fe-158a-42cb-b98e-a3beb330ee7f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "cinder-quobyte-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "cinder-quobyte-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf90dc-ffdd-4204-8195-bd1f94a37bea]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:58 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f Sep 23 00:15:58 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:59 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" returned: 0 in 0.854s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:59 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f Sep 23 00:15:59 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:59 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" returned: 0 in 0.526s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "cinder-quobyte-43a9b3fe-158a-42cb-b98e-a3beb330ee7f" released by "delete_volume" :: held 1.472s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Created reservations ['a1cc947d-5747-4527-8e4a-cc3cd5ce9acf', '8a6a0bb7-cab3-429a-bcba-e560f2b23dab', '5e30b5d8-54df-4af7-984e-4f05605ae185', 'f6077e2b-7cb4-4597-a448-cc1d076a44df', '7e57a811-3513-4af1-9124-6424ee0206c7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:00 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:16:00 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:00 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.567s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Deleted volume successfully. Sep 23 00:16:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e99c6936-122a-4273-87d4-6bc311ca8b0d tempest-DeleteServersTestJSON-951041124 None] Lock "cinder-43a9b3fe-158a-42cb-b98e-a3beb330ee7f-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-1c09d074-cb78-478b-8575-1f0f7916d1a3 tempest-ServerActionsTestOtherA-1197368108 None] Terminate volume connection completed successfully. Sep 23 00:16:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-1c09d074-cb78-478b-8575-1f0f7916d1a3 tempest-ServerActionsTestOtherA-1197368108 None] Deleting attachment 3e3066a1-3ee0-4b63-ab71-270e56533bf7. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:11 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:INSERT=8,cinder:SELECT=34,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-343927ca-10b0-401e-85b1-a20358dc6a93 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-343927ca-10b0-401e-85b1-a20358dc6a93 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-343927ca-10b0-401e-85b1-a20358dc6a93 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-343927ca-10b0-401e-85b1-a20358dc6a93 tempest-ServerActionsTestOtherA-1197368108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-eca547ad-2552-4a5b-96d8-1006dd3063c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fb80899-a687-439f-967e-b05c18988273', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-058f46ca-d4ed-4d46-85f9-5d2b3d1af3ee req-343927ca-10b0-401e-85b1-a20358dc6a93 tempest-ServerActionsTestOtherA-1197368108 None] attachment_update completed successfully. Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Flow 'volume_create_manager' (a66666c6-1ace-437d-b02d-42e7f740fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53da4fc-75d2-4cf0-b1a2-f522b5b73be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53da4fc-75d2-4cf0-b1a2-f522b5b73be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1013870229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833728a1-f969-4bb5-bcee-c0b2309b4a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77137730b484e669fd8f01d8d14ea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:17Z,use_quota=True,user_id='600387ddc0a0403d8a1f7b8b3b38ed0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527ce1fd-b23f-48eb-bf20-25120dd3037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527ce1fd-b23f-48eb-bf20-25120dd3037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da720584-b7f4-49f4-afdf-2e715afa97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da720584-b7f4-49f4-afdf-2e715afa97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833728a1-f969-4bb5-bcee-c0b2309b4a00', 'volume_name': 'volume-833728a1-f969-4bb5-bcee-c0b2309b4a00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009ad686-e96d-4f46-82f8-0490321c6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009ad686-e96d-4f46-82f8-0490321c6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef5684c-135a-4983-b798-b4383dc11a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Volume 833728a1-f969-4bb5-bcee-c0b2309b4a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833728a1-f969-4bb5-bcee-c0b2309b4a00', 'volume_size': 1} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1013870229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833728a1-f969-4bb5-bcee-c0b2309b4a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77137730b484e669fd8f01d8d14ea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:17Z,use_quota=True,user_id='600387ddc0a0403d8a1f7b8b3b38ed0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Creating volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:17 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:16:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:17 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 1073741824 Sep 23 00:16:17 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:18 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 1073741824" returned: 0 in 0.952s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:18 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 Sep 23 00:16:18 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:19 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00" returned: 0 in 0.562s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef5684c-135a-4983-b798-b4383dc11a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833728a1-f969-4bb5-bcee-c0b2309b4a00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51914e75-f770-4eeb-a0ba-cf70374ec1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Volume volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 (833728a1-f969-4bb5-bcee-c0b2309b4a00): created successfully Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51914e75-f770-4eeb-a0ba-cf70374ec1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Flow 'volume_create_manager' (a66666c6-1ace-437d-b02d-42e7f740fec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-638bff33-f18c-4995-9a74-40e79c889a5e tempest-SnapshotsActionsTest-487797430 None] Created volume successfully. Sep 23 00:16:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Creating offline snapshot 7d85bbaf-103b-45f3-8775-b1a04e92fc96 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f9e0d-5224-4566-b80a-d1553486db15]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 Sep 23 00:16:20 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (3f0baa98-8af9-4908-8b47-46bf0805a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e0c92a-2458-4e7a-b6ab-6cc254cf0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e0c92a-2458-4e7a-b6ab-6cc254cf0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1525423686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7f746b-24da-4363-8922-1d5039dd5909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:21Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7e8e57-301e-4136-bd02-4711781c34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7e8e57-301e-4136-bd02-4711781c34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f455aabb-4450-488a-8253-b9d813f8d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f455aabb-4450-488a-8253-b9d813f8d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7f746b-24da-4363-8922-1d5039dd5909', 'volume_name': 'volume-ab7f746b-24da-4363-8922-1d5039dd5909', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff579c-f7d1-4d47-91cc-d2930d13fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ff579c-f7d1-4d47-91cc-d2930d13fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07987724-57f7-4071-b8d3-cf0ce185ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Volume ab7f746b-24da-4363-8922-1d5039dd5909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7f746b-24da-4363-8922-1d5039dd5909', 'volume_size': 1} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:21 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00" returned: 0 in 1.144s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 1G Sep 23 00:16:21 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 1G" returned: 0 in 0.863s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:22 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 is being set with open permissions: ugo+rw Sep 23 00:16:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:22 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.628s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info Sep 23 00:16:23 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info is being set with open permissions: ugo+rw Sep 23 00:16:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info Sep 23 00:16:23 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.info" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1525423686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7f746b-24da-4363-8922-1d5039dd5909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:21Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Creating volume ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[92081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 1073741824 Sep 23 00:16:24 devstack sudo[92081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-793f3e2b-ed6f-4ee7-9d5a-c480f0525219 tempest-SnapshotsActionsTest-487797430 None] Create snapshot completed successfully Sep 23 00:16:24 devstack sudo[92081]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 1073741824" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 Sep 23 00:16:25 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:25 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07987724-57f7-4071-b8d3-cf0ce185ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7f746b-24da-4363-8922-1d5039dd5909', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb713bb-1743-4eb6-b165-c2332b7361da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Volume volume-ab7f746b-24da-4363-8922-1d5039dd5909 (ab7f746b-24da-4363-8922-1d5039dd5909): created successfully Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb713bb-1743-4eb6-b165-c2332b7361da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (3f0baa98-8af9-4908-8b47-46bf0805a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-67aa4c80-e595-436b-8bff-8d7c28e56d87 tempest-VolumesSnapshotTestJSON-780886432 None] Created volume successfully. Sep 23 00:16:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Creating offline snapshot 7c84c260-325f-43cc-943e-2b9c71a31809 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd4a31-2066-4fd8-8cd2-0651476d523a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:26 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:27 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.647s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 1G Sep 23 00:16:27 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 1G" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 Sep 23 00:16:27 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809" returned: 0 in 0.386s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 is being set with open permissions: ugo+rw Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 Sep 23 00:16:28 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.534s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Creating offline snapshot 0a5fc3d6-31c8-4f2b-af83-899e0878fc0c of volume ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c2baa1-0c73-4414-98f7-716473e5dc4b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b84d8215-d3ad-42fd-b2cc-c59a1510a183 tempest-SnapshotsActionsTest-487797430 None] Create snapshot completed successfully Sep 23 00:16:28 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 Sep 23 00:16:28 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909" returned: 0 in 0.483s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:29 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c 1G Sep 23 00:16:29 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c 1G" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7f746b-24da-4363-8922-1d5039dd5909 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:29 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7f746b-24da-4363-8922-1d5039dd5909 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c Sep 23 00:16:29 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-7c84c260-325f-43cc-943e-2b9c71a31809-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-7c84c260-325f-43cc-943e-2b9c71a31809-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-7c84c260-325f-43cc-943e-2b9c71a31809" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-7c84c260-325f-43cc-943e-2b9c71a31809" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Deleting offline snapshot 7c84c260-325f-43cc-943e-2b9c71a31809 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] snapshot_file for this snap is: volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4865d1-0c14-4add-83ce-63b0ba65b3a2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7f746b-24da-4363-8922-1d5039dd5909 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c is being set with open permissions: ugo+rw Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c Sep 23 00:16:30 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 Sep 23 00:16:30 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809" returned: 0 in 0.549s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:30 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info Sep 23 00:16:30 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5ffa9-60ba-4ed7-9689-55067d8bafd0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:30 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:30 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info is being set with open permissions: ugo+rw Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info Sep 23 00:16:31 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.646s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 Sep 23 00:16:31 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:31 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.info" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c5255389-df47-4c6d-9c6f-58da0aefefb1 tempest-VolumesSnapshotTestJSON-780886432 None] Create snapshot completed successfully Sep 23 00:16:32 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809" returned: 0 in 0.672s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:32 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809 Sep 23 00:16:32 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7c84c260-325f-43cc-943e-2b9c71a31809" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-7c84c260-325f-43cc-943e-2b9c71a31809" released by "_delete_snapshot" :: held 2.525s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_snapshot" :: held 2.580s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:32 devstack cinder-volume[86731]: WARNING cinder.quota [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Created reservations ['ac2cd882-c24d-4ec0-947a-cb9c398e42e0', '4373b771-7b2d-43e3-b9ad-af17170fa86e', 'a6834c63-72dc-4515-b996-fe1de6c2b19f', 'ccbfd04c-7615-4131-a7bd-046768ae5cbf', '965a2f6d-72f6-499b-b3b7-8f61c839158d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:16:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Deleting offline snapshot 0a5fc3d6-31c8-4f2b-af83-899e0878fc0c of volume ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] snapshot_file for this snap is: volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d2f1cb-6d32-4de1-a2e2-1c982c0eb4ba]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Delete snapshot completed successfully. Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d11cf23c-58db-401a-85f3-491664b333d9 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-7c84c260-325f-43cc-943e-2b9c71a31809-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:33 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c Sep 23 00:16:33 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Creating offline snapshot fea98aa1-e7e5-4915-b8bf-17786804f93f of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b2984-99e3-4d15-967a-068523f0314e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" returned: 0 in 0.970s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab7f746b-24da-4363-8922-1d5039dd5909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7362367-2b64-4fe5-9999-2e29a05ee628]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:34 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:34 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 Sep 23 00:16:34 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:34 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909" returned: 0 in 0.735s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c Sep 23 00:16:35 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 1.002s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f 1G Sep 23 00:16:35 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" returned: 0 in 0.583s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:35 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c Sep 23 00:16:35 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:35 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909.0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:35 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f 1G" returned: 0 in 0.884s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c" released by "_delete_snapshot" :: held 2.927s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" released by "delete_snapshot" :: held 3.077s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:36 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f Sep 23 00:16:36 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['ab53c073-d6ca-4048-9319-ebcc3514fad3', '84177273-6ebb-4832-9851-dcf319155348', 'c7903d09-5e42-44c9-ba1c-4de751918ed7', '86fef144-22b2-4e0e-8dbe-672d1f2c9958', '52636b06-1f84-46bd-9b39-dfc49bc6a8a9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:16:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Delete snapshot completed successfully. Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8260a6b6-0b8d-4183-b78b-1642614f60b4 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-0a5fc3d6-31c8-4f2b-af83-899e0878fc0c-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:36 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f" returned: 0 in 0.595s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f is being set with open permissions: ugo+rw Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:36 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f Sep 23 00:16:36 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:36 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-13442744-376a-4ac5-b5e0-1a79d317bdbe tempest-SnapshotsActionsTest-487797430 None] Create snapshot completed successfully Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-fea98aa1-e7e5-4915-b8bf-17786804f93f-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:16:37 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-fea98aa1-e7e5-4915-b8bf-17786804f93f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-fea98aa1-e7e5-4915-b8bf-17786804f93f" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-fea98aa1-e7e5-4915-b8bf-17786804f93f" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Deleting offline snapshot fea98aa1-e7e5-4915-b8bf-17786804f93f of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] snapshot_file for this snap is: volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53d7a30-15a5-4a0a-8433-1e4184122cea]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:37 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f Sep 23 00:16:37 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:37 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:38 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f" returned: 0 in 0.695s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf1447-35ea-488f-ba78-9ec1166783af]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:38 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (f32cf00b-f3db-41c9-a42f-af4cff84ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e515c250-9eb1-4e80-92ba-a40ec8c916d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e515c250-9eb1-4e80-92ba-a40ec8c916d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-140841644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff61e34a-21cb-4b11-bdd0-002d7c9c4a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:39Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33830c5-b638-4738-9d92-d3a4100beb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33830c5-b638-4738-9d92-d3a4100beb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4df8ba-debc-4802-8625-523891cb6bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4df8ba-debc-4802-8625-523891cb6bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff61e34a-21cb-4b11-bdd0-002d7c9c4a38', 'volume_name': 'volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfca70a-742e-4410-bb4f-f46e4fcab867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfca70a-742e-4410-bb4f-f46e4fcab867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ab62f8-b462-421e-8354-dc9932f540a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:38 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Volume ff61e34a-21cb-4b11-bdd0-002d7c9c4a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38', 'volume_size': 1} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-140841644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff61e34a-21cb-4b11-bdd0-002d7c9c4a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:39Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Creating volume ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:38 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:16:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:38 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 1073741824 Sep 23 00:16:38 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.837s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f Sep 23 00:16:39 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 1073741824" returned: 0 in 0.938s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:16:39 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f" returned: 0 in 0.793s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f Sep 23 00:16:40 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ab62f8-b462-421e-8354-dc9932f540a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66e5069-0f1f-4adf-bc1f-772f107fae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Volume volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 (ff61e34a-21cb-4b11-bdd0-002d7c9c4a38): created successfully Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66e5069-0f1f-4adf-bc1f-772f107fae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (f32cf00b-f3db-41c9-a42f-af4cff84ed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-db4c442e-b6cd-4a7c-88a9-9e1250d864df tempest-VolumesSnapshotTestJSON-780886432 None] Created volume successfully. Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=57,cinder:UPDATE=63,cinder:DELETE=7,cinder:INSERT=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:40 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.fea98aa1-e7e5-4915-b8bf-17786804f93f" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-fea98aa1-e7e5-4915-b8bf-17786804f93f" released by "_delete_snapshot" :: held 3.130s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_snapshot" :: held 3.214s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Created reservations ['3bda64f6-ac31-4c0e-9266-624e1133e4a6', '24568db9-969b-4a0d-9eaf-24f08a1e21b0', 'dcd9f69b-dfe8-4f85-ab70-530bd2fa2ea3', 'ed362915-c875-4760-b83b-e8922e35d61b', 'fd133c0b-854e-407c-b54c-074d2ee25ec3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:16:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Delete snapshot completed successfully. Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2eaf036-cd6e-418a-9954-a7a294114d33 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-fea98aa1-e7e5-4915-b8bf-17786804f93f-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Creating offline snapshot 72d7da5f-d5df-4266-bcda-b66fe8121884 of volume ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[de128dbd-3a1c-444e-9e7d-404456d927ad]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:16:41 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:41 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.576s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 1G Sep 23 00:16:41 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:42 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 1G" returned: 0 in 0.832s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:16:42 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 is being set with open permissions: ugo+rw Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:16:43 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info Sep 23 00:16:43 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info is being set with open permissions: ugo+rw Sep 23 00:16:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info Sep 23 00:16:43 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:44 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.info" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.067s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.676s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Creating offline snapshot 647b044b-a271-45fd-a856-711eff560f91 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-41dec3b6-31f2-4b64-84c2-1464627326b9 tempest-VolumesSnapshotTestJSON-780886432 None] Create snapshot completed successfully Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a02f1-c78e-4cdf-a8fa-ea60490d42ce]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:44 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:44 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 1.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 1G Sep 23 00:16:45 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 1G" returned: 0 in 1.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 Sep 23 00:16:47 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (f107c33a-7463-4ab5-b9b8-c25f28ff3439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061fd824-6470-4342-8d91-a6ffc65d6667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061fd824-6470-4342-8d91-a6ffc65d6667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098165674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9954497b-4208-409d-929f-54f44f2a4c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=72d7da5f-d5df-4266-bcda-b66fe8121884,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:48Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56fa6d3-e6bd-404e-b624-ac4d04afb2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56fa6d3-e6bd-404e-b624-ac4d04afb2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe914bc-2bb0-465c-afda-ce7603145888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe914bc-2bb0-465c-afda-ce7603145888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9954497b-4208-409d-929f-54f44f2a4c27', 'volume_name': 'volume-9954497b-4208-409d-929f-54f44f2a4c27', 'volume_size': 2, 'snapshot_id': '72d7da5f-d5df-4266-bcda-b66fe8121884'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f840b7-3418-4ac3-95bc-e529b8bd4002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f840b7-3418-4ac3-95bc-e529b8bd4002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996bb314-bef1-440c-913d-0d70e6066fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Volume 9954497b-4208-409d-929f-54f44f2a4c27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9954497b-4208-409d-929f-54f44f2a4c27', 'volume_size': 2, 'snapshot_id': '72d7da5f-d5df-4266-bcda-b66fe8121884'} Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:48 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91" returned: 0 in 0.973s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:48 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 is being set with open permissions: ugo+rw Sep 23 00:16:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:48 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 Sep 23 00:16:48 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91" returned: 0 in 0.707s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.967s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884-9954497b-4208-409d-929f-54f44f2a4c27" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884-9954497b-4208-409d-929f-54f44f2a4c27" acquired by "_create_volume_from_snapshot" :: waited 0.125s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Creating volume 9954497b-4208-409d-929f-54f44f2a4c27 from snapshot 72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bea65d33-fd91-47f3-a452-d228c4300fc2 tempest-SnapshotsActionsTest-487797430 None] Create snapshot completed successfully Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" acquired by "_copy_volume_from_snapshot" :: waited 0.065s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] snapshot: 72d7da5f-d5df-4266-bcda-b66fe8121884, volume: 9954497b-4208-409d-929f-54f44f2a4c27, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[75119fa0-9312-418d-8a29-a2dc0412204f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:16:49 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 0.662s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9cb32b-5ada-4d2a-9ace-0759fba2a6ce]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-647b044b-a271-45fd-a856-711eff560f91-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-647b044b-a271-45fd-a856-711eff560f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-647b044b-a271-45fd-a856-711eff560f91" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-647b044b-a271-45fd-a856-711eff560f91" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Deleting offline snapshot 647b044b-a271-45fd-a856-711eff560f91 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:50 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:16:50 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] snapshot_file for this snap is: volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b99f3d-26a5-400b-a4b4-635a3b0e0507]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 Sep 23 00:16:51 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.988s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:16:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:16:51 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:16:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 Sep 23 00:16:51 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:52 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91" returned: 0 in 1.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6404a0-5b1e-41f8-80ce-9539aed9c2a8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:52 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:16:52 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:54 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 1.864s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:54 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 Sep 23 00:16:54 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:56 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91" returned: 0 in 2.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:56 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91 Sep 23 00:16:56 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:57 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.647b044b-a271-45fd-a856-711eff560f91" returned: 0 in 1.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-647b044b-a271-45fd-a856-711eff560f91" released by "_delete_snapshot" :: held 7.581s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_snapshot" :: held 7.657s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Created reservations ['002453b4-65d8-4414-bbd3-7aa698b999a0', '439fbd81-6b20-486f-8dfc-721f50d46316', 'd3574a97-168a-4d42-818d-d4ac2ddd0dd8', '7d4e6b5c-1a74-441a-9a8f-8f39e11eab0d', '3d1a0722-2508-4a47-ae4c-a129b6774c3b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:16:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Delete snapshot completed successfully. Sep 23 00:16:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b9c83d9-78c0-4352-a7ee-a873b1e6532a tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-647b044b-a271-45fd-a856-711eff560f91-delete_snapshot" released by "delete_snapshot" :: held 8.465s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-80dfdb8f-3b99-422d-8c1a-bf4c997a5ca0 tempest-ServerActionsTestOtherA-1197368108 None] Terminate volume connection completed successfully. Sep 23 00:17:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-80dfdb8f-3b99-422d-8c1a-bf4c997a5ca0 tempest-ServerActionsTestOtherA-1197368108 None] Deleting attachment 2fb80899-a687-439f-967e-b05c18988273. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "cinder-eca547ad-2552-4a5b-96d8-1006dd3063c8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-eca547ad-2552-4a5b-96d8-1006dd3063c8-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "cinder-quobyte-eca547ad-2552-4a5b-96d8-1006dd3063c8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-quobyte-eca547ad-2552-4a5b-96d8-1006dd3063c8" acquired by "delete_volume" :: waited 0.067s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d6973-3e15-4345-a251-a2a381f0304e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:03 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 Sep 23 00:17:03 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:04 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8" returned: 0 in 1.914s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:04 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8 Sep 23 00:17:04 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "cinder-38c87edb-bb5f-4286-be5d-1b9a1059c27d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-38c87edb-bb5f-4286-be5d-1b9a1059c27d-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "cinder-quobyte-38c87edb-bb5f-4286-be5d-1b9a1059c27d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-quobyte-38c87edb-bb5f-4286-be5d-1b9a1059c27d" acquired by "delete_volume" :: waited 0.077s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbf142-25c6-48f6-8eb0-a2a03bce5bf6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:05 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-eca547ad-2552-4a5b-96d8-1006dd3063c8" returned: 0 in 0.823s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-quobyte-eca547ad-2552-4a5b-96d8-1006dd3063c8" released by "delete_volume" :: held 3.070s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG cinder.quota [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Created reservations ['b7024e57-3078-426e-a109-6754e6ce5804', 'ee7229e5-70db-4dcd-9c95-5ddec1e3444a', '35d769ef-05cc-4821-a9ea-8e7827bfa3bf', '3c187469-939d-42ce-bdd9-0f7ed6891fa7', 'b8ff65b2-4847-43b5-ac27-1661bfc2f8b4'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:05 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d Sep 23 00:17:05 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:06 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:06 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:06 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Flow 'volume_create_manager' (7ee23fe0-eec1-47a2-9b73-4ce796e3abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2becbc4c-c8ef-45e4-ab8f-108a5495d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d" returned: 0 in 1.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2becbc4c-c8ef-45e4-ab8f-108a5495d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1574527996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befa2473-9015-4745-87cd-342a4db4574c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d491f1a4465498db9a8d8bd34b6f358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:07Z,use_quota=True,user_id='d10c250150ed459eb0e032326dbd7034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7d305-137c-4f61-b656-21f66d48fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7d305-137c-4f61-b656-21f66d48fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b571b6-a5c0-485e-bb8a-8afba4098b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:06 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b571b6-a5c0-485e-bb8a-8afba4098b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'befa2473-9015-4745-87cd-342a4db4574c', 'volume_name': 'volume-befa2473-9015-4745-87cd-342a4db4574c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:06 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37099c1-6dd5-4104-bc57-5201acbe662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37099c1-6dd5-4104-bc57-5201acbe662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b10d7e-1da7-494a-b230-561b489a3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Volume befa2473-9015-4745-87cd-342a4db4574c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-befa2473-9015-4745-87cd-342a4db4574c', 'volume_size': 1} Sep 23 00:17:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:07 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.129s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG cinder.manager [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Deleted volume successfully. Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-caf1838d-db4d-4d41-ae2d-f21953bdde74 req-ce7d9ddb-5b9a-4dcb-bd36-0c07160da439 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-eca547ad-2552-4a5b-96d8-1006dd3063c8-delete_volume" released by "delete_volume" :: held 5.072s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:07 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-38c87edb-bb5f-4286-be5d-1b9a1059c27d" returned: 0 in 0.820s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-quobyte-38c87edb-bb5f-4286-be5d-1b9a1059c27d" released by "delete_volume" :: held 2.515s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Created reservations ['8ee9681e-7398-4722-af71-6b2c18dc1444', '4c4110ec-f081-4217-9fdd-9dbc1f923fac', 'daebb5b8-f4e0-45e7-8504-7f03d3186b7a', 'e3ce25e4-9d2a-4349-85ac-0c98c4d292e2', 'f7bba995-65f8-4bf6-b15c-bb8bf9b046fb'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:08 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:08 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.816s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Deleted volume successfully. Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9118895a-fafb-4a5c-9dad-f03e016dcbc3 tempest-ServerActionsTestOtherA-1197368108 None] Lock "cinder-38c87edb-bb5f-4286-be5d-1b9a1059c27d-delete_volume" released by "delete_volume" :: held 4.291s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:09 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27" returned: 0 in 18.161s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38, size 1024.00 MB, duration 18.16 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:17:09 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Converted 1024.00 MB image at 56.38 MB/s Sep 23 00:17:09 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 is being set with open permissions: ugo+rw Sep 23 00:17:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 Sep 23 00:17:09 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27" returned: 0 in 0.466s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" released by "_copy_volume_from_snapshot" :: held 20.552s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884-9954497b-4208-409d-929f-54f44f2a4c27" released by "_create_volume_from_snapshot" :: held 20.881s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 21.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.408s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Creating offline snapshot adc6b8d9-de7d-4257-92a4-1a6df9861e72 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996bb314-bef1-440c-913d-0d70e6066fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9954497b-4208-409d-929f-54f44f2a4c27', 'volume_size': 2, 'snapshot_id': '72d7da5f-d5df-4266-bcda-b66fe8121884'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072314e6-f78d-44f5-8985-308416a8b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1ce0c7-e302-4847-bb42-0f2e103aa989]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Volume volume-9954497b-4208-409d-929f-54f44f2a4c27 (9954497b-4208-409d-929f-54f44f2a4c27): created successfully Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072314e6-f78d-44f5-8985-308416a8b212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (f107c33a-7463-4ab5-b9b8-c25f28ff3439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c91e42e-e7b3-4c71-a652-aca89f6a54f8 tempest-VolumesSnapshotTestJSON-780886432 None] Created volume successfully. Sep 23 00:17:10 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:17:10 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:11 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:11 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 1G Sep 23 00:17:11 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-9954497b-4208-409d-929f-54f44f2a4c27-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-9954497b-4208-409d-929f-54f44f2a4c27-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=78,cinder:UPDATE=72,cinder:INSERT=26,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:12 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 1G" returned: 0 in 1.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4382c7-15b5-4be8-83f0-9b7f0be025e0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 Sep 23 00:17:12 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:12 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 Sep 23 00:17:12 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72" returned: 0 in 0.893s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 is being set with open permissions: ugo+rw Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 Sep 23 00:17:13 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27" returned: 0 in 1.064s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27 Sep 23 00:17:13 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.574s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.863s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1574527996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befa2473-9015-4745-87cd-342a4db4574c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d491f1a4465498db9a8d8bd34b6f358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:07Z,use_quota=True,user_id='d10c250150ed459eb0e032326dbd7034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Creating volume befa2473-9015-4745-87cd-342a4db4574c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:17:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c 1073741824 Sep 23 00:17:13 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dd247db8-9b7e-4d4c-8bc8-7a336822e306 tempest-SnapshotsActionsTest-487797430 None] Create snapshot completed successfully Sep 23 00:17:14 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9954497b-4208-409d-929f-54f44f2a4c27" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-9954497b-4208-409d-929f-54f44f2a4c27" released by "delete_volume" :: held 1.730s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['3d19a32f-176d-4c19-8dd8-74a432e8dbba', '4a4fafae-8a3e-415e-bd10-3bd0ade18bf9', 'd5a19a41-cd3e-4597-b17f-d3448d0fee7f', '9fce0847-b271-4986-a83f-a23bf5a93ad0', '74c19b5c-1cee-4c4e-ac80-94c7551fdeb9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:14 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-adc6b8d9-de7d-4257-92a4-1a6df9861e72-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-adc6b8d9-de7d-4257-92a4-1a6df9861e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Acquiring lock "cinder-quobyte-adc6b8d9-de7d-4257-92a4-1a6df9861e72" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:15 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-72d7da5f-d5df-4266-bcda-b66fe8121884-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c 1073741824" returned: 0 in 1.217s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-adc6b8d9-de7d-4257-92a4-1a6df9861e72" acquired by "_delete_snapshot" :: waited 0.198s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Deleting offline snapshot adc6b8d9-de7d-4257-92a4-1a6df9861e72 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:15 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] snapshot_file for this snap is: volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-72d7da5f-d5df-4266-bcda-b66fe8121884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.217s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.963s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69737103-1c09-41dc-9cff-67a519333578]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Deleted volume successfully. Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f47bbf75-7322-4acd-b27c-bef41ba56c32 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-9954497b-4208-409d-929f-54f44f2a4c27-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Deleting offline snapshot 72d7da5f-d5df-4266-bcda-b66fe8121884 of volume ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:15 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c Sep 23 00:17:15 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] snapshot_file for this snap is: volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e6b45-c312-4300-80b1-80ba74f1e0c0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 Sep 23 00:17:15 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:17:15 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b10d7e-1da7-494a-b230-561b489a3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befa2473-9015-4745-87cd-342a4db4574c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b980882d-9f2f-4f7f-9f4c-3a07e294e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Volume volume-befa2473-9015-4745-87cd-342a4db4574c (befa2473-9015-4745-87cd-342a4db4574c): created successfully Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b980882d-9f2f-4f7f-9f4c-3a07e294e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Flow 'volume_create_manager' (7ee23fe0-eec1-47a2-9b73-4ce796e3abfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d690d8b6-2783-42bf-a749-679b684b5682 tempest-ServerRescueNegativeTestJSON-1740177398 None] Created volume successfully. Sep 23 00:17:16 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72" returned: 0 in 0.976s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c739f8a-90b5-4b9d-967a-4fa977aa4cb5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:17:16 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 1.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b369d6-54d6-438b-9c4d-76711497445a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:17 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:17:17 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 1.059s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:17 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 Sep 23 00:17:17 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.938s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:17 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:17:17 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72" returned: 0 in 0.859s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72 Sep 23 00:17:18 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 0.869s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884 Sep 23 00:17:18 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.adc6b8d9-de7d-4257-92a4-1a6df9861e72" returned: 0 in 0.537s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-adc6b8d9-de7d-4257-92a4-1a6df9861e72" released by "_delete_snapshot" :: held 3.742s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_snapshot" :: held 3.968s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Created reservations ['724f03ae-180d-456c-b658-b54bb9791199', '45a18de5-8d50-43ec-b1f3-0cdaae9d2044', 'af1eaf9e-858c-4a88-816e-d12255821a5d', '1d96b6d4-f44c-4c41-8e0e-5a5b06ecc515', '63a2b81d-b7f5-47e6-85a3-b0a430378c3d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:19 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Delete snapshot completed successfully. Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38.72d7da5f-d5df-4266-bcda-b66fe8121884" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fdc9223-2829-467d-9954-86ff58bc7065 tempest-SnapshotsActionsTest-591282671 None] Lock "cinder-adc6b8d9-de7d-4257-92a4-1a6df9861e72-delete_snapshot" released by "delete_snapshot" :: held 4.313s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-72d7da5f-d5df-4266-bcda-b66fe8121884" released by "_delete_snapshot" :: held 3.842s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" released by "delete_snapshot" :: held 3.917s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['9109ecba-00f0-4db8-a89b-2879ec697e90', 'be424ef0-1615-4126-9924-72305c30e5d8', '0762074c-02ed-4479-8a70-0154bc71fced', '9f5b8d9d-e27a-453d-8317-15f95bb56c00', 'c8d84c50-8b23-4138-85be-73f34c6f5e2d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Delete snapshot completed successfully. Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-993cc12f-2dfc-4f27-890e-22ecda6f1b12 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-72d7da5f-d5df-4266-bcda-b66fe8121884-delete_snapshot" released by "delete_snapshot" :: held 4.215s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" acquired by "delete_volume" :: waited 0.052s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45f0ff-c435-48d0-85cd-6f76f9953d8f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:17:20 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "cinder-7d85bbaf-103b-45f3-8775-b1a04e92fc96-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-7d85bbaf-103b-45f3-8775-b1a04e92fc96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "cinder-quobyte-7d85bbaf-103b-45f3-8775-b1a04e92fc96" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-7d85bbaf-103b-45f3-8775-b1a04e92fc96" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Deleting offline snapshot 7d85bbaf-103b-45f3-8775-b1a04e92fc96 of volume 833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] snapshot_file for this snap is: volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a306a-2b19-4a5e-b8d4-f2009f5502a5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.684s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38 Sep 23 00:17:20 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:17:20 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833728a1-f969-4bb5-bcee-c0b2309b4a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9566748-6492-40cf-8d47-49458dedf0fc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" returned: 0 in 0.489s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38" released by "delete_volume" :: held 1.321s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['16983a24-6e4f-43ac-bf8d-ef00733083f3', '822a19f0-bd6a-492f-ad8f-ab6401c4d6be', '342d302c-984a-4ba8-9906-3d84152a0f08', 'd4d372c8-eccc-4083-9df3-221b745543c9', '80862897-0db7-42bb-a6e8-119bdc299a02'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:21 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 Sep 23 00:17:21 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:21 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00" returned: 0 in 0.802s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:17:22 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.827s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Deleted volume successfully. Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-09882f17-d7d9-4327-a11b-24b506c6c22f tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-ff61e34a-21cb-4b11-bdd0-002d7c9c4a38-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:22 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.713s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96 Sep 23 00:17:22 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00.7d85bbaf-103b-45f3-8775-b1a04e92fc96" returned: 0 in 0.392s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (367f8a2e-3325-4a1d-b221-7efbce7527a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3836923-d4c5-4fa6-b5fa-2ca1747da83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-7d85bbaf-103b-45f3-8775-b1a04e92fc96" released by "_delete_snapshot" :: held 2.627s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_snapshot" :: held 2.690s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3836923-d4c5-4fa6-b5fa-2ca1747da83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1703909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc68e919-21f5-4f71-b60f-674eb4b687c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:23Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5914edbd-2316-4e99-b1e9-bf8e913f2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5914edbd-2316-4e99-b1e9-bf8e913f2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24962b18-bfad-40b7-be19-50bbc96abe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24962b18-bfad-40b7-be19-50bbc96abe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc68e919-21f5-4f71-b60f-674eb4b687c2', 'volume_name': 'volume-cc68e919-21f5-4f71-b60f-674eb4b687c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f59d8d-89fa-4623-8846-29d12082bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f59d8d-89fa-4623-8846-29d12082bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3000e4cd-668a-4181-9498-f27d1bfef2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Volume cc68e919-21f5-4f71-b60f-674eb4b687c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc68e919-21f5-4f71-b60f-674eb4b687c2', 'volume_size': 1} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1703909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc68e919-21f5-4f71-b60f-674eb4b687c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:23Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Creating volume cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 1073741824 Sep 23 00:17:23 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Created reservations ['61c8e982-1a30-4cb7-81bc-52f316a105fb', '9304a9ab-dd61-4373-99fb-ab40863e3fa1', '85cd5a8f-83b2-404b-899b-1d97883e4d97', '5a8f629e-1bf9-4f7e-a5c9-72d6ad8ccb4c', 'db48344a-5e9d-4c00-ae70-504faac3c6aa'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Delete snapshot completed successfully. Sep 23 00:17:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff222dc8-6da5-4f63-80f1-6417f9700d67 tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-7d85bbaf-103b-45f3-8775-b1a04e92fc96-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "cinder-833728a1-f969-4bb5-bcee-c0b2309b4a00-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-833728a1-f969-4bb5-bcee-c0b2309b4a00-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ea1ca-ab0d-48a7-9c4d-0e36c7e15019]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:24 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 1073741824" returned: 0 in 1.105s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:24 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:24 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:24 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 Sep 23 00:17:24 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:25 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00" returned: 0 in 1.001s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:25 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:25 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00 Sep 23 00:17:25 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.944s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3000e4cd-668a-4181-9498-f27d1bfef2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc68e919-21f5-4f71-b60f-674eb4b687c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67845bc-2a77-4bf3-8d16-ae7f353aac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Volume volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 (cc68e919-21f5-4f71-b60f-674eb4b687c2): created successfully Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67845bc-2a77-4bf3-8d16-ae7f353aac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (367f8a2e-3325-4a1d-b221-7efbce7527a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-331ff391-d195-429a-8d29-9f57bc543d21 tempest-VolumesSnapshotTestJSON-780886432 None] Created volume successfully. Sep 23 00:17:25 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-833728a1-f969-4bb5-bcee-c0b2309b4a00" returned: 0 in 0.359s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-quobyte-833728a1-f969-4bb5-bcee-c0b2309b4a00" released by "delete_volume" :: held 1.507s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Created reservations ['2f04b7ca-c64a-4d2a-8502-0c0c36a1607e', '3a871ab9-ca05-4314-a95e-8a353865fb34', 'ac8f3cd7-bc87-4b4a-bab1-45bb154e59c6', '6d1134ad-1789-4556-9654-30be319c515d', '08d8b842-419a-4bcf-8088-3a0997fe9f9d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:26 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:26 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:26 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Deleted volume successfully. Sep 23 00:17:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7d2e379-37e0-4cb5-ab71-48648ee2bd2a tempest-SnapshotsActionsTest-487797430 None] Lock "cinder-833728a1-f969-4bb5-bcee-c0b2309b4a00-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Creating offline snapshot 4dc53d5e-eebb-4e77-9cbf-47764fb6790d of volume cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[321159f5-cf44-4644-9d33-6915db8d141c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:27 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:27 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:27 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.888s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:28 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d 1G Sep 23 00:17:28 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:28 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d 1G" returned: 0 in 0.850s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:28 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:28 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:29 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.674s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d is being set with open permissions: ugo+rw Sep 23 00:17:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:29 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:29 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:29 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:30 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info Sep 23 00:17:30 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:30 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:30 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info is being set with open permissions: ugo+rw Sep 23 00:17:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:30 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info Sep 23 00:17:30 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:30 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.info" returned: 0 in 0.466s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.904s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-91a062b9-23b9-458c-ba2a-8d17d6c02edd tempest-VolumesSnapshotTestJSON-780886432 None] Create snapshot completed successfully Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Acquiring lock "cinder-befa2473-9015-4745-87cd-342a4db4574c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "cinder-befa2473-9015-4745-87cd-342a4db4574c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Acquiring lock "cinder-quobyte-befa2473-9015-4745-87cd-342a4db4574c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "cinder-quobyte-befa2473-9015-4745-87cd-342a4db4574c" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[568cb551-fec1-4f94-aad3-39dbc010a2e5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:31 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c Sep 23 00:17:31 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:32 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c" returned: 0 in 0.805s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:32 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c Sep 23 00:17:32 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (b4fa94ec-eafa-402a-b8ef-659230d9ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd6fb39-2c5a-4371-9c13-87960eaba58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd6fb39-2c5a-4371-9c13-87960eaba58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-33225057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0f79a5-ab93-4f42-9197-f407edfb520d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef60fe6c32543728cf588d34b1f25cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4dc53d5e-eebb-4e77-9cbf-47764fb6790d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:33Z,use_quota=True,user_id='906dd3c96fb2470ba952e74de0a5a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fea785-e51e-4ca5-bf04-6e6da0d4a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fea785-e51e-4ca5-bf04-6e6da0d4a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f0a238-9b33-406e-91ff-749b766b4963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f0a238-9b33-406e-91ff-749b766b4963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf0f79a5-ab93-4f42-9197-f407edfb520d', 'volume_name': 'volume-cf0f79a5-ab93-4f42-9197-f407edfb520d', 'volume_size': 1, 'snapshot_id': '4dc53d5e-eebb-4e77-9cbf-47764fb6790d'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e236b9c5-9319-4851-9e69-f0a941bf476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e236b9c5-9319-4851-9e69-f0a941bf476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:33 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c056d4a-8532-4089-8da1-f0d07fcb552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Volume cf0f79a5-ab93-4f42-9197-f407edfb520d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf0f79a5-ab93-4f42-9197-f407edfb520d', 'volume_size': 1, 'snapshot_id': '4dc53d5e-eebb-4e77-9cbf-47764fb6790d'} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-befa2473-9015-4745-87cd-342a4db4574c" returned: 0 in 0.915s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-cf0f79a5-ab93-4f42-9197-f407edfb520d" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "cinder-quobyte-befa2473-9015-4745-87cd-342a4db4574c" released by "delete_volume" :: held 1.869s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-cf0f79a5-ab93-4f42-9197-f407edfb520d" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Creating volume cf0f79a5-ab93-4f42-9197-f407edfb520d from snapshot 4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] snapshot: 4dc53d5e-eebb-4e77-9cbf-47764fb6790d, volume: cf0f79a5-ab93-4f42-9197-f407edfb520d, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548b869-48ae-4689-8883-ba97f4fe0a57]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Created reservations ['91277ef9-07b7-49b0-9528-762d4fd11fcf', 'a42f5b4e-7d1a-45ce-a349-5a3a72acacb0', 'a80af173-a5dc-473c-a2ad-5a7eb2095d1f', '35a492fb-75e0-4918-9cc4-05c4f4ae2d39', '6b90f198-e02b-4e06-b8bf-12ba0ab4161a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:33 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:33 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:33 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:33 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:34 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.773s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc68e919-21f5-4f71-b60f-674eb4b687c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a21a2-443a-48fd-83e0-ce0b9af802b7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:34 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.633s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:34 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:34 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Deleted volume successfully. Sep 23 00:17:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c9eec28c-9b9d-459b-b059-58d6987601e3 tempest-ServerRescueNegativeTestJSON-1740177398 None] Lock "cinder-befa2473-9015-4745-87cd-342a4db4574c-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:35 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.783s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:17:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:17:35 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:17:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:35 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d Sep 23 00:17:35 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:37 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:37 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:38 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 1.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:38 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:17:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:17:43 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=49,cinder:UPDATE=73,cinder:DELETE=3,cinder:INSERT=19 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:44 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=94,cinder:INSERT=26,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:46 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d" returned: 0 in 11.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:46 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2, size 1024.00 MB, duration 11.47 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:17:46 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Converted 1024.00 MB image at 89.30 MB/s Sep 23 00:17:46 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d is being set with open permissions: ugo+rw Sep 23 00:17:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:46 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d Sep 23 00:17:46 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:46 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" released by "_copy_volume_from_snapshot" :: held 13.675s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-cf0f79a5-ab93-4f42-9197-f407edfb520d" released by "_create_volume_from_snapshot" :: held 13.778s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.804s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c056d4a-8532-4089-8da1-f0d07fcb552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0f79a5-ab93-4f42-9197-f407edfb520d', 'volume_size': 1, 'snapshot_id': '4dc53d5e-eebb-4e77-9cbf-47764fb6790d'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727d0cc1-4c26-4528-910f-116d5b2263c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Volume volume-cf0f79a5-ab93-4f42-9197-f407edfb520d (cf0f79a5-ab93-4f42-9197-f407edfb520d): created successfully Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727d0cc1-4c26-4528-910f-116d5b2263c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Flow 'volume_create_manager' (b4fa94ec-eafa-402a-b8ef-659230d9ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0b653ee6-3a3b-48ef-9856-e908f534bf99 tempest-VolumesSnapshotTestJSON-780886432 None] Created volume successfully. Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-cf0f79a5-ab93-4f42-9197-f407edfb520d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-cf0f79a5-ab93-4f42-9197-f407edfb520d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eaeb01-935b-4ec3-b170-e54ea173e14c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:47 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d Sep 23 00:17:47 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:48 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:48 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d Sep 23 00:17:48 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:48 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f79a5-ab93-4f42-9197-f407edfb520d" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cf0f79a5-ab93-4f42-9197-f407edfb520d" released by "delete_volume" :: held 0.953s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['3f40647d-c098-4c0d-a9ed-48f63de99e27', 'e17728ac-20ba-4f3c-9b08-e6d1f1ca0b73', 'd319b8ac-8f22-4f11-8cc4-8f108512e424', 'c2a3b168-270f-4479-af18-ed81a9397a74', '98a45685-6d8d-4c9a-902c-46807f98c7d5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:48 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:48 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:49 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Deleted volume successfully. Sep 23 00:17:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97f8813a-01fc-47e6-b140-3a05b62a10df tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-cf0f79a5-ab93-4f42-9197-f407edfb520d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Deleting offline snapshot 4dc53d5e-eebb-4e77-9cbf-47764fb6790d of volume cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] snapshot_file for this snap is: volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f369d5-db66-4977-8139-915fdc0f107b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:50 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:50 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:50 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.592s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc68e919-21f5-4f71-b60f-674eb4b687c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03ffd6-b1bf-4586-b692-f47f1c5abdc5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:50 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:50 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:51 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.793s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:51 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:51 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:52 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:52 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d Sep 23 00:17:52 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:52 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2.4dc53d5e-eebb-4e77-9cbf-47764fb6790d" returned: 0 in 0.365s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-4dc53d5e-eebb-4e77-9cbf-47764fb6790d" released by "_delete_snapshot" :: held 2.432s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" released by "delete_snapshot" :: held 2.474s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['7a4332b3-c7fb-4406-b098-3c6353f94e42', '03797d25-e770-4232-8a5e-e87c10584484', 'f9d40959-f7fb-4137-8c65-3a0b63250154', 'e607cd7c-ba3b-4cb4-ab1e-520a316d1db7', 'e76876eb-947d-4a59-8915-8150f5fcadd2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Delete snapshot completed successfully. Sep 23 00:17:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7216031f-bdfa-4010-a269-91213c37e900 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-4dc53d5e-eebb-4e77-9cbf-47764fb6790d-delete_snapshot" released by "delete_snapshot" :: held 2.706s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-cc68e919-21f5-4f71-b60f-674eb4b687c2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-cc68e919-21f5-4f71-b60f-674eb4b687c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[966aef72-77f6-4af1-80ef-04c7409a8a6b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:53 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:53 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2 Sep 23 00:17:54 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cc68e919-21f5-4f71-b60f-674eb4b687c2" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-cc68e919-21f5-4f71-b60f-674eb4b687c2" released by "delete_volume" :: held 0.942s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['fe1d9da3-1585-44e8-8d90-6f04e57342ea', '1d26c04f-2b40-4e8d-aba8-162676712ee5', '903df995-4a88-48c9-a718-e11ff98a5777', '4a341419-89cb-44eb-ac68-bf073efa4646', '6805b9dd-9bc8-456c-8999-3370c5a5b15e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:54 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:55 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Deleted volume successfully. Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b796d7cc-08f1-42db-8637-c732cb0a6aa5 tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-cc68e919-21f5-4f71-b60f-674eb4b687c2-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-ab7f746b-24da-4363-8922-1d5039dd5909-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-ab7f746b-24da-4363-8922-1d5039dd5909-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6536dc-cf69-4e3d-9fb2-a114cc264cd2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:56 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 Sep 23 00:17:56 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:56 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909" returned: 0 in 0.632s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:56 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909 Sep 23 00:17:56 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab7f746b-24da-4363-8922-1d5039dd5909" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-quobyte-ab7f746b-24da-4363-8922-1d5039dd5909" released by "delete_volume" :: held 1.249s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Created reservations ['f83c350d-ed75-454b-aa4d-e5d533e2a5f3', 'caa23964-6633-4274-a842-bcaabf7a1b30', 'acced8dc-da39-4611-a4c0-982515af60b9', '72595891-72d7-410b-912a-3cc3b191e517', 'b64cf241-3472-481d-bd00-467556e4ef89'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:57 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:17:57 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.469s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:58 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Deleted volume successfully. Sep 23 00:17:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e6dd32-4fe5-4c4f-bb6a-2596f9fc535d tempest-VolumesSnapshotTestJSON-780886432 None] Lock "cinder-ab7f746b-24da-4363-8922-1d5039dd5909-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Flow 'volume_create_manager' (9bf886bc-be3a-4088-8543-7438556dc968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf5c3a-af15-4220-aeff-8be6410feef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccf5c3a-af15-4220-aeff-8be6410feef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2060061527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057d465e-d576-4d9f-ad8e-c75e5eeb10ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68acc3550aa4ef18ca4e68e2a63a7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:04Z,use_quota=True,user_id='eddbf637ac664793b26758bf6b348f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7c06a-b13e-491b-8630-4e1827801878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb7c06a-b13e-491b-8630-4e1827801878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cae122-93b8-45ce-bfe4-ba2eb51e0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cae122-93b8-45ce-bfe4-ba2eb51e0451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '057d465e-d576-4d9f-ad8e-c75e5eeb10ba', 'volume_name': 'volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e45fa97-429a-4c7e-9068-f6afb0f1032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e45fa97-429a-4c7e-9068-f6afb0f1032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4d3f19-487a-4f0d-b009-df52c05cc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Volume 057d465e-d576-4d9f-ad8e-c75e5eeb10ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba', 'volume_size': 1} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2060061527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=057d465e-d576-4d9f-ad8e-c75e5eeb10ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68acc3550aa4ef18ca4e68e2a63a7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:04Z,use_quota=True,user_id='eddbf637ac664793b26758bf6b348f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Creating volume 057d465e-d576-4d9f-ad8e-c75e5eeb10ba {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:18:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:03 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba 1073741824 Sep 23 00:18:03 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:04 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba 1073741824" returned: 0 in 0.622s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:04 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba Sep 23 00:18:04 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:04 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4d3f19-487a-4f0d-b009-df52c05cc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfd381-6273-4074-9620-fc328a583438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Volume volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba (057d465e-d576-4d9f-ad8e-c75e5eeb10ba): created successfully Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfd381-6273-4074-9620-fc328a583438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Flow 'volume_create_manager' (9bf886bc-be3a-4088-8543-7438556dc968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-20975521-ac3f-4d6d-a295-c1fb4a75ea1d tempest-VolumeQuotasNegativeTestJSON-599209463 None] Created volume successfully. Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Acquiring lock "cinder-057d465e-d576-4d9f-ad8e-c75e5eeb10ba-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "cinder-057d465e-d576-4d9f-ad8e-c75e5eeb10ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Acquiring lock "cinder-quobyte-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "cinder-quobyte-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" acquired by "delete_volume" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbbe67a-1e2e-4596-91ff-575b75c9964e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:08 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba Sep 23 00:18:08 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" returned: 0 in 0.685s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:08 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba Sep 23 00:18:08 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "cinder-quobyte-057d465e-d576-4d9f-ad8e-c75e5eeb10ba" released by "delete_volume" :: held 1.198s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Created reservations ['306cf901-b2db-4b7f-8ec7-a2b7f4fec096', 'ac6d895b-897e-4d32-9072-d60a39d23633', 'c1032d30-7e40-4fa1-8fad-a449845863d8', '188a78f4-81f7-40cb-9df2-9bc654ce79d7', '82d0e841-a53c-4a63-ad74-fa6e4220d778'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:09 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Deleted volume successfully. Sep 23 00:18:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-01fad192-b3c9-47ed-8301-55c7b9374351 tempest-VolumeQuotasNegativeTestJSON-599209463 None] Lock "cinder-057d465e-d576-4d9f-ad8e-c75e5eeb10ba-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Flow 'volume_create_manager' (eba2275e-48c1-419c-ad21-a71c6bc3c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c85ca16-56f1-48e3-88b6-e8a9c4b6b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c85ca16-56f1-48e3-88b6-e8a9c4b6b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1400649268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0226745e-94ea-4a71-9225-e8d513995e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42349dc82c84004932cccac0cd55c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:14Z,use_quota=True,user_id='465e21821c6d49979578075ddb4701b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada7638-a630-444e-ad33-3c8bdbb21902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ada7638-a630-444e-ad33-3c8bdbb21902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f572fd6-2c8d-4175-987f-ef1c382f42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f572fd6-2c8d-4175-987f-ef1c382f42db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0226745e-94ea-4a71-9225-e8d513995e71', 'volume_name': 'volume-0226745e-94ea-4a71-9225-e8d513995e71', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece14df9-6f54-4cd7-9c8f-c3dd88ca6ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece14df9-6f54-4cd7-9c8f-c3dd88ca6ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73b32c-2b74-4392-959f-38b45625b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Volume 0226745e-94ea-4a71-9225-e8d513995e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0226745e-94ea-4a71-9225-e8d513995e71', 'volume_size': 2} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1400649268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0226745e-94ea-4a71-9225-e8d513995e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42349dc82c84004932cccac0cd55c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:14Z,use_quota=True,user_id='465e21821c6d49979578075ddb4701b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Creating volume 0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:18:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 2147483648 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:13 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 2147483648 Sep 23 00:18:13 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:14 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 2147483648" returned: 0 in 0.824s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:14 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 Sep 23 00:18:14 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:15 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73b32c-2b74-4392-959f-38b45625b40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0226745e-94ea-4a71-9225-e8d513995e71', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bffce09-6358-4208-82fa-7ef7d029ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Volume volume-0226745e-94ea-4a71-9225-e8d513995e71 (0226745e-94ea-4a71-9225-e8d513995e71): created successfully Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bffce09-6358-4208-82fa-7ef7d029ee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Flow 'volume_create_manager' (eba2275e-48c1-419c-ad21-a71c6bc3c186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4ab066dc-503c-4799-a58d-2b5878c8093d tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Created volume successfully. Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Creating offline snapshot 084a55c9-ff5d-406a-95b9-fd393499044f of volume 0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c76ba45-c3d1-4c6c-a86b-859c777f066c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 Sep 23 00:18:16 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:16 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71" returned: 0 in 0.638s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:16 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f 2G Sep 23 00:18:16 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:17 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f 2G" returned: 0 in 0.689s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0226745e-94ea-4a71-9225-e8d513995e71 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:17 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0226745e-94ea-4a71-9225-e8d513995e71 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f Sep 23 00:18:17 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:18 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0226745e-94ea-4a71-9225-e8d513995e71 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f" returned: 0 in 0.684s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:18 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f is being set with open permissions: ugo+rw Sep 23 00:18:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:18 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f Sep 23 00:18:18 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:18 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f" returned: 0 in 0.749s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:19 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info Sep 23 00:18:19 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:19 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info" returned: 0 in 0.707s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:19 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info is being set with open permissions: ugo+rw Sep 23 00:18:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:19 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info Sep 23 00:18:19 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:20 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.info" returned: 0 in 0.551s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.289s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5783d243-c0e3-4c0b-8496-c43ae4a2b64a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Create snapshot completed successfully Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "cinder-084a55c9-ff5d-406a-95b9-fd393499044f-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-084a55c9-ff5d-406a-95b9-fd393499044f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "cinder-quobyte-084a55c9-ff5d-406a-95b9-fd393499044f" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-084a55c9-ff5d-406a-95b9-fd393499044f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Deleting offline snapshot 084a55c9-ff5d-406a-95b9-fd393499044f of volume 0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] snapshot_file for this snap is: volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9f59f0-cd61-47f2-af50-8795e5631cae]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:22 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f Sep 23 00:18:22 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:23 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f" returned: 0 in 1.006s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0226745e-94ea-4a71-9225-e8d513995e71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf99f44-75e1-42cd-acfe-42ebd16dd19e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:23 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 Sep 23 00:18:23 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:24 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71" returned: 0 in 0.975s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:24 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f Sep 23 00:18:24 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:24 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f" returned: 0 in 0.673s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:24 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f Sep 23 00:18:24 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:25 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71.084a55c9-ff5d-406a-95b9-fd393499044f" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-084a55c9-ff5d-406a-95b9-fd393499044f" released by "_delete_snapshot" :: held 3.617s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" released by "delete_snapshot" :: held 3.679s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Created reservations ['6d7996a0-0faf-4153-83e4-08bfa4a6df91', 'b28851d6-38eb-45d1-a6f7-bdd1b5259bea', '81456d3a-4529-444a-82db-012b72075d62', 'f167ef2d-e629-41fa-a53c-20e645f4b9e4', '77f0df41-cb6d-48f1-a36c-58e088372767'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:18:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Delete snapshot completed successfully. Sep 23 00:18:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e018f17-2dce-42d2-8693-c02a929b6861 tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-084a55c9-ff5d-406a-95b9-fd393499044f-delete_snapshot" released by "delete_snapshot" :: held 4.112s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "cinder-0226745e-94ea-4a71-9225-e8d513995e71-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-0226745e-94ea-4a71-9225-e8d513995e71-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0c5b6-894c-4e61-a009-e6630e888bf7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:26 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 Sep 23 00:18:26 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Flow 'volume_create_manager' (6bd53a66-4514-4fde-9c55-79c09a953330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8353ff-5ecd-4a4f-a89e-865206f49442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8353ff-5ecd-4a4f-a89e-865206f49442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1676016859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647e1a5a-8baf-4951-8e50-e8fa9f28eeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480d694bb0774f019967d5246c97f2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:27Z,use_quota=True,user_id='80b49a3b31a24af6a84987f1af043f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(847d2661-6794-49f4-86bb-cddfe8be5e18),volume_type_id=847d2661-6794-49f4-86bb-cddfe8be5e18)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a3ea68-ef81-41a2-a6fa-6a2060931a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a3ea68-ef81-41a2-a6fa-6a2060931a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917f4d2-53fa-4787-b057-5090b271524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8917f4d2-53fa-4787-b057-5090b271524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647e1a5a-8baf-4951-8e50-e8fa9f28eeae', 'volume_name': 'volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c6d549-986c-440a-abd9-f93b33c09c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c6d549-986c-440a-abd9-f93b33c09c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd822ca-8426-4ffc-9988-78ba543ef050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Volume 647e1a5a-8baf-4951-8e50-e8fa9f28eeae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae', 'volume_size': 1} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1676016859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647e1a5a-8baf-4951-8e50-e8fa9f28eeae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480d694bb0774f019967d5246c97f2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:27Z,use_quota=True,user_id='80b49a3b31a24af6a84987f1af043f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(847d2661-6794-49f4-86bb-cddfe8be5e18),volume_type_id=847d2661-6794-49f4-86bb-cddfe8be5e18)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Creating volume 647e1a5a-8baf-4951-8e50-e8fa9f28eeae {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae 1073741824 Sep 23 00:18:27 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71" returned: 0 in 0.784s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71 Sep 23 00:18:27 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0226745e-94ea-4a71-9225-e8d513995e71" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-quobyte-0226745e-94ea-4a71-9225-e8d513995e71" released by "delete_volume" :: held 1.385s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:28 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae 1073741824" returned: 0 in 0.717s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Created reservations ['09a52bd9-f929-4704-aa59-4d24496fbedd', '70e61619-348b-4066-85f3-354c3fadc331', '7eff3f75-82ff-4689-841f-8a498da86a92', '538c45d7-50a8-40a6-b764-74ccfc378b86', '77351d46-fc5a-4324-98a8-02b33c5a4d92'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:28 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae Sep 23 00:18:28 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:28 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:28 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd822ca-8426-4ffc-9988-78ba543ef050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c1e3a6-7e67-4183-97f8-3f72e895292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Volume volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae (647e1a5a-8baf-4951-8e50-e8fa9f28eeae): created successfully Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c1e3a6-7e67-4183-97f8-3f72e895292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Flow 'volume_create_manager' (6bd53a66-4514-4fde-9c55-79c09a953330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b1d8d163-5ac6-47d1-844e-69c602624a3a tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Created volume successfully. Sep 23 00:18:28 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Deleted volume successfully. Sep 23 00:18:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-54f8af4a-c44a-4392-9785-f60267fa7f1a tempest-VolumesSnapshotNegativeTestJSON-728889657 None] Lock "cinder-0226745e-94ea-4a71-9225-e8d513995e71-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:30 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:30 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:30 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.549s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-78f9ebb5-b826-4492-b1fe-e561b5e18dc2 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Retype volume completed successfully. Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "cinder-647e1a5a-8baf-4951-8e50-e8fa9f28eeae-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "cinder-647e1a5a-8baf-4951-8e50-e8fa9f28eeae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "cinder-quobyte-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "cinder-quobyte-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[02858894-c55a-4b5f-b5b8-67dc42b3b0b4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:31 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae Sep 23 00:18:31 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:32 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" returned: 0 in 0.696s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:32 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae Sep 23 00:18:32 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:32 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "cinder-quobyte-647e1a5a-8baf-4951-8e50-e8fa9f28eeae" released by "delete_volume" :: held 1.257s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:33 devstack cinder-volume[86731]: WARNING cinder.quota [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:18:33 devstack cinder-volume[86731]: WARNING cinder.quota [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Created reservations ['9a27ff30-8795-4826-892c-ba27721acc64', '37148bdc-e46a-4034-8c23-a632a3beeb9b', 'ab997b34-823c-4698-ae96-2beba035aede', 'a2cb0a50-a371-4e55-b3d0-771f365943f9', 'fcc2ee24-6bf7-4075-a93a-00acf1c00fb1'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:33 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:33 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:33 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.657s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Deleted volume successfully. Sep 23 00:18:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dad931a6-9a45-46c2-b6ae-00a3ada1e7c6 tempest-VolumeRetypeWithoutMigrationTest-94192299 None] Lock "cinder-647e1a5a-8baf-4951-8e50-e8fa9f28eeae-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:37 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:37 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:37 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:43 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=87,cinder:DELETE=3,cinder:SELECT=69,cinder:INSERT=21 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:43 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=66,cinder:UPDATE=83,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (60792d8d-503d-427f-94f3-bef2617b9590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6c5c6d-801f-4e57-9591-850fc903aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6c5c6d-801f-4e57-9591-850fc903aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-29771698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7854842-1337-46c1-b316-0997d49e8def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:46Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8120b55-a001-4879-9122-cce90051e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8120b55-a001-4879-9122-cce90051e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be19647-c5d6-4a87-a4c2-3674879b1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be19647-c5d6-4a87-a4c2-3674879b1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7854842-1337-46c1-b316-0997d49e8def', 'volume_name': 'volume-f7854842-1337-46c1-b316-0997d49e8def', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933a8fdf-a722-4d65-b6c4-e0bc5ae13d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933a8fdf-a722-4d65-b6c4-e0bc5ae13d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79519700-dbfd-4a9f-8dfa-aee9cb154cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Volume f7854842-1337-46c1-b316-0997d49e8def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7854842-1337-46c1-b316-0997d49e8def', 'volume_size': 1} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-29771698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7854842-1337-46c1-b316-0997d49e8def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:46Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Creating volume f7854842-1337-46c1-b316-0997d49e8def {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:46 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:18:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def 1073741824 Sep 23 00:18:46 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def 1073741824" returned: 0 in 1.117s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def Sep 23 00:18:48 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79519700-dbfd-4a9f-8dfa-aee9cb154cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7854842-1337-46c1-b316-0997d49e8def', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9e3b1e-db48-4f69-a55a-c88768e61492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Flow 'volume_create_manager' (c7349562-9dd7-4a3d-ae95-059018aef3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d1c274-70d0-4e0c-9daf-328ab94dba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d1c274-70d0-4e0c-9daf-328ab94dba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-398085104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5608357a-4d2c-4904-9c52-421bf56ac003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07aa404a1aff41dc937a3e878b5aba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:48Z,use_quota=True,user_id='3c2bf56a0ac2486aaad2f9e4e1ffe3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50defa6e-727e-4edd-a1ca-8f3ef669be0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50defa6e-727e-4edd-a1ca-8f3ef669be0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad70a03e-9750-4d01-89c3-7cd805e1b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad70a03e-9750-4d01-89c3-7cd805e1b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5608357a-4d2c-4904-9c52-421bf56ac003', 'volume_name': 'volume-5608357a-4d2c-4904-9c52-421bf56ac003', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03003560-b641-41c0-b747-2299cf3c8d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03003560-b641-41c0-b747-2299cf3c8d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bb4717-7c98-4102-8ffe-50d46017390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Volume 5608357a-4d2c-4904-9c52-421bf56ac003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5608357a-4d2c-4904-9c52-421bf56ac003', 'volume_size': 1} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-398085104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5608357a-4d2c-4904-9c52-421bf56ac003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07aa404a1aff41dc937a3e878b5aba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:48Z,use_quota=True,user_id='3c2bf56a0ac2486aaad2f9e4e1ffe3fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Creating volume 5608357a-4d2c-4904-9c52-421bf56ac003 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Volume volume-f7854842-1337-46c1-b316-0997d49e8def (f7854842-1337-46c1-b316-0997d49e8def): created successfully Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9e3b1e-db48-4f69-a55a-c88768e61492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (60792d8d-503d-427f-94f3-bef2617b9590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c41456cc-e8eb-48ae-8ca4-64d4d3b6600e tempest-AttachVolumeTestJSON-20470943 None] Created volume successfully. Sep 23 00:18:48 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 1073741824 Sep 23 00:18:48 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 1073741824" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 Sep 23 00:18:49 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003" returned: 0 in 0.689s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bb4717-7c98-4102-8ffe-50d46017390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5608357a-4d2c-4904-9c52-421bf56ac003', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78eb0f45-8ad1-49d3-afbb-01afbac60072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Volume volume-5608357a-4d2c-4904-9c52-421bf56ac003 (5608357a-4d2c-4904-9c52-421bf56ac003): created successfully Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78eb0f45-8ad1-49d3-afbb-01afbac60072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Flow 'volume_create_manager' (c7349562-9dd7-4a3d-ae95-059018aef3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ae6feec7-dfba-4aee-a97f-57d2176b9a5a tempest-VolumesServicesTestJSON-480335857 None] Created volume successfully. Sep 23 00:18:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d1fb257c-2225-4dab-8d01-38d4e7c177d1 req-c144c909-c22e-49f6-82dd-acd0bcca1b4a tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d1fb257c-2225-4dab-8d01-38d4e7c177d1 req-c144c909-c22e-49f6-82dd-acd0bcca1b4a tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d1fb257c-2225-4dab-8d01-38d4e7c177d1 req-c144c909-c22e-49f6-82dd-acd0bcca1b4a tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d1fb257c-2225-4dab-8d01-38d4e7c177d1 req-c144c909-c22e-49f6-82dd-acd0bcca1b4a tempest-AttachVolumeTestJSON-20470943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-f7854842-1337-46c1-b316-0997d49e8def', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1059905-ff62-4e32-9c8d-c1397bcbf704', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:18:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d1fb257c-2225-4dab-8d01-38d4e7c177d1 req-c144c909-c22e-49f6-82dd-acd0bcca1b4a tempest-AttachVolumeTestJSON-20470943 None] attachment_update completed successfully. Sep 23 00:18:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Acquiring lock "cinder-5608357a-4d2c-4904-9c52-421bf56ac003-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "cinder-5608357a-4d2c-4904-9c52-421bf56ac003-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Acquiring lock "cinder-quobyte-5608357a-4d2c-4904-9c52-421bf56ac003" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "cinder-quobyte-5608357a-4d2c-4904-9c52-421bf56ac003" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f4fe59-5aa0-4122-980f-92b6d4a9d84d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:52 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 Sep 23 00:18:52 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003" returned: 0 in 0.992s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003 Sep 23 00:18:53 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5608357a-4d2c-4904-9c52-421bf56ac003" returned: 0 in 0.562s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "cinder-quobyte-5608357a-4d2c-4904-9c52-421bf56ac003" released by "delete_volume" :: held 1.649s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Created reservations ['b56b6ded-f00d-4474-8bd2-f5eee47a30b6', 'b5243dd3-5bcf-4132-8650-c0c73405c910', '48670e01-6e4d-41b3-af9e-9715172d400b', '881550f7-0594-4f75-9aef-d24482929f63', '6bdfacf6-aba0-4845-8fdf-58a0e4d5ac45'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:54 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:18:54 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:54 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.572s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Deleted volume successfully. Sep 23 00:18:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55e92856-53af-426f-b529-83f00a42d6b0 tempest-VolumesServicesTestJSON-480335857 None] Lock "cinder-5608357a-4d2c-4904-9c52-421bf56ac003-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:03 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:04 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Flow 'volume_create_manager' (0f251c0e-7cc2-486a-b8ef-5ee8dbc4fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f9d3c4-d009-43bc-bc31-55a48e6c620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f9d3c4-d009-43bc-bc31-55a48e6c620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1458814677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3e65d7-44ce-4f9a-bbac-82655e1c20b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ef36330ec490692da902a8c231f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:08Z,use_quota=True,user_id='d2bb7461a4e543d68af5e5614037b5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f506171c-c030-4b77-b49b-3bfd3febbca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f506171c-c030-4b77-b49b-3bfd3febbca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43dd136-7ed3-4b43-938f-683bd0cb9fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43dd136-7ed3-4b43-938f-683bd0cb9fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3e65d7-44ce-4f9a-bbac-82655e1c20b4', 'volume_name': 'volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d691386b-8c19-467f-8d70-597e216764cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d691386b-8c19-467f-8d70-597e216764cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b77e4f-677b-4d9d-a08e-4e4649d992c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Volume 1f3e65d7-44ce-4f9a-bbac-82655e1c20b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4', 'volume_size': 1} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1458814677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3e65d7-44ce-4f9a-bbac-82655e1c20b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ef36330ec490692da902a8c231f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:08Z,use_quota=True,user_id='d2bb7461a4e543d68af5e5614037b5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Creating volume 1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 1073741824 Sep 23 00:19:08 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 1073741824" returned: 0 in 0.813s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 Sep 23 00:19:09 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:09 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b77e4f-677b-4d9d-a08e-4e4649d992c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c25897-85e6-4280-9674-3d196743fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Volume volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 (1f3e65d7-44ce-4f9a-bbac-82655e1c20b4): created successfully Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c25897-85e6-4280-9674-3d196743fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Flow 'volume_create_manager' (0f251c0e-7cc2-486a-b8ef-5ee8dbc4fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df8474d3-2678-497f-a4ff-da8ef24ce58f tempest-ServersNegativeTestJSON-1648555361 None] Created volume successfully. Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Flow 'volume_create_manager' (5a470821-e973-4f76-ab0e-194f1b058146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c36db-1054-4b28-887f-5557026147e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c36db-1054-4b28-887f-5557026147e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1666704275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a64a65-33e4-4d67-acc5-d8010105c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ef36330ec490692da902a8c231f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:16Z,use_quota=True,user_id='d2bb7461a4e543d68af5e5614037b5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dfca8f-ada3-4550-ad08-fb5555585975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72dfca8f-ada3-4550-ad08-fb5555585975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cf659-36b9-4501-9514-dc8ba021aa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cf659-36b9-4501-9514-dc8ba021aa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a64a65-33e4-4d67-acc5-d8010105c5ba', 'volume_name': 'volume-54a64a65-33e4-4d67-acc5-d8010105c5ba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0f9fcd-a653-4e46-9373-8fb775bd5f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0f9fcd-a653-4e46-9373-8fb775bd5f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6270f5e0-840d-4417-a561-7bb435b8c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Volume 54a64a65-33e4-4d67-acc5-d8010105c5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a64a65-33e4-4d67-acc5-d8010105c5ba', 'volume_size': 1} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1666704275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a64a65-33e4-4d67-acc5-d8010105c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ef36330ec490692da902a8c231f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:16Z,use_quota=True,user_id='d2bb7461a4e543d68af5e5614037b5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Creating volume 54a64a65-33e4-4d67-acc5-d8010105c5ba {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba 1073741824 Sep 23 00:19:16 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba 1073741824" returned: 0 in 1.051s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba Sep 23 00:19:17 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6270f5e0-840d-4417-a561-7bb435b8c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a64a65-33e4-4d67-acc5-d8010105c5ba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864d15bd-4527-4360-bb40-d74f990c08d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Volume volume-54a64a65-33e4-4d67-acc5-d8010105c5ba (54a64a65-33e4-4d67-acc5-d8010105c5ba): created successfully Sep 23 00:19:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864d15bd-4527-4360-bb40-d74f990c08d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Flow 'volume_create_manager' (5a470821-e973-4f76-ab0e-194f1b058146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5c476c9e-38fb-4b9a-84f5-8e0fdecc1c13 tempest-ServersNegativeTestJSON-1648555361 None] Created volume successfully. Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "cinder-54a64a65-33e4-4d67-acc5-d8010105c5ba-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-54a64a65-33e4-4d67-acc5-d8010105c5ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "cinder-quobyte-54a64a65-33e4-4d67-acc5-d8010105c5ba" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-quobyte-54a64a65-33e4-4d67-acc5-d8010105c5ba" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c13e98-eaf1-4750-9ab7-b33768ec4323]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba Sep 23 00:19:20 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba" returned: 0 in 0.565s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba Sep 23 00:19:20 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-54a64a65-33e4-4d67-acc5-d8010105c5ba" returned: 0 in 0.417s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-quobyte-54a64a65-33e4-4d67-acc5-d8010105c5ba" released by "delete_volume" :: held 1.056s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Created reservations ['a0d827f2-2957-4d88-8d4a-b348597c9127', '67129613-5049-4921-8323-bf3ab758112e', 'be6a40f5-bfcf-4ad3-b839-117cd84df1c9', 'b01a7078-a8aa-49ba-88e4-132a54c28a0d', 'ae4b76fc-9bb0-48f9-9731-93a29f02ba34'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:19:21 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Deleted volume successfully. Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e475744-cb81-491b-8f60-90208d517b4e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-54a64a65-33e4-4d67-acc5-d8010105c5ba-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "cinder-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "cinder-quobyte-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-quobyte-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbd1e4-c534-41ae-8028-3393391e6866]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Flow 'volume_create_manager' (3f85b85c-0a50-4666-9675-b07abea6f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e27a026-fc60-45bc-8039-cdffbf59e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 Sep 23 00:19:23 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e27a026-fc60-45bc-8039-cdffbf59e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1972910113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d492ef3f-1230-44ee-86b8-b1d338d2336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921488e87b934673ad4268b0ecbcfaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:23Z,use_quota=True,user_id='1f254d28905b48bfa1d321e417daea87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22240810-85ea-4892-a9b8-de028a60441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22240810-85ea-4892-a9b8-de028a60441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585b7f6e-2a60-4988-9741-2b15e08eb761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585b7f6e-2a60-4988-9741-2b15e08eb761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd492ef3f-1230-44ee-86b8-b1d338d2336e', 'volume_name': 'volume-d492ef3f-1230-44ee-86b8-b1d338d2336e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b988a2-525a-4e24-acf2-5b9a5a55ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b988a2-525a-4e24-acf2-5b9a5a55ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7cddad-89c8-42ca-bbf9-051f0b36a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Volume d492ef3f-1230-44ee-86b8-b1d338d2336e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d492ef3f-1230-44ee-86b8-b1d338d2336e', 'volume_size': 1} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1972910113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d492ef3f-1230-44ee-86b8-b1d338d2336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921488e87b934673ad4268b0ecbcfaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:23Z,use_quota=True,user_id='1f254d28905b48bfa1d321e417daea87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Creating volume d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e 1073741824 Sep 23 00:19:23 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" returned: 0 in 0.680s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4 Sep 23 00:19:23 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (fe691633-e4f7-4e14-93e3-b7c4c5a328c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc68aa9b-ef43-46ad-af33-bc74ead4c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc68aa9b-ef43-46ad-af33-bc74ead4c866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-58697775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8b53fa-de25-44a2-b295-458b687fcf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5a3f1f-7c5e-475c-80ef-22d07b75b266),volume_type_id=fd5a3f1f-7c5e-475c-80ef-22d07b75b266)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f3961b-fa30-435e-8432-3ebf6275077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f3961b-fa30-435e-8432-3ebf6275077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0084c0ad-c070-4085-b2fe-128fe9121770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0084c0ad-c070-4085-b2fe-128fe9121770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8b53fa-de25-44a2-b295-458b687fcf0c', 'volume_name': 'volume-ab8b53fa-de25-44a2-b295-458b687fcf0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1f8622-ff48-484d-bb5c-932f10e9e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1f8622-ff48-484d-bb5c-932f10e9e987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b84c6d-11ae-4ca3-a4c9-039988e46054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume ab8b53fa-de25-44a2-b295-458b687fcf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8b53fa-de25-44a2-b295-458b687fcf0c', 'volume_size': 1} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:23 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-quobyte-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4" released by "delete_volume" :: held 1.185s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:23 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e 1073741824" returned: 0 in 0.847s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e Sep 23 00:19:24 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Created reservations ['6a81e72c-5018-4fd7-a557-96bc3cd208a2', 'e26909f0-f5dd-4806-a04f-2200bdf84175', '481bf5b8-5866-457d-863d-b641cffe1d97', '154bbfb3-e935-4ddf-bb19-7f82761b56a0', 'cf088629-56d3-41a9-971a-3cf4652d7979'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:19:24 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:24 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (a5309d04-08b4-4f89-890e-14571c7bffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cdb863-21c9-4a1a-9bcd-337613716d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-58697775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8b53fa-de25-44a2-b295-458b687fcf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd5a3f1f-7c5e-475c-80ef-22d07b75b266),volume_type_id=fd5a3f1f-7c5e-475c-80ef-22d07b75b266)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Creating volume ab8b53fa-de25-44a2-b295-458b687fcf0c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cdb863-21c9-4a1a-9bcd-337613716d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-362109882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124e3725-78ad-421c-bebc-99c83e2eb985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0c65297-ae3b-41aa-830b-1e7cfc340dcf),volume_type_id=c0c65297-ae3b-41aa-830b-1e7cfc340dcf)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc63c399-d8e6-4941-b7dd-9984ab32b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c 1073741824 Sep 23 00:19:24 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc63c399-d8e6-4941-b7dd-9984ab32b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8066801-f43f-4a7f-ac32-418324f2742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8066801-f43f-4a7f-ac32-418324f2742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124e3725-78ad-421c-bebc-99c83e2eb985', 'volume_name': 'volume-124e3725-78ad-421c-bebc-99c83e2eb985', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ac284d-2268-4214-8caa-ec27bd44f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ac284d-2268-4214-8caa-ec27bd44f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbe3177-bb2e-4ba9-bc37-19d38c246831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume 124e3725-78ad-421c-bebc-99c83e2eb985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124e3725-78ad-421c-bebc-99c83e2eb985', 'volume_size': 1} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7cddad-89c8-42ca-bbf9-051f0b36a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d492ef3f-1230-44ee-86b8-b1d338d2336e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83b28c-0556-4e4d-9bf3-713e4c4d8ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Volume volume-d492ef3f-1230-44ee-86b8-b1d338d2336e (d492ef3f-1230-44ee-86b8-b1d338d2336e): created successfully Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83b28c-0556-4e4d-9bf3-713e4c4d8ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Flow 'volume_create_manager' (3f85b85c-0a50-4666-9675-b07abea6f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:24 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Deleted volume successfully. Sep 23 00:19:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9bd29eef-111f-44db-b76a-fdcea80281a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Created volume successfully. Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24d25c21-be23-4610-97e7-c4a6e3b9da6e tempest-ServersNegativeTestJSON-1648555361 None] Lock "cinder-1f3e65d7-44ce-4f9a-bbac-82655e1c20b4-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:24 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c 1073741824" returned: 0 in 0.557s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c Sep 23 00:19:25 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-362109882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124e3725-78ad-421c-bebc-99c83e2eb985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:24Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0c65297-ae3b-41aa-830b-1e7cfc340dcf),volume_type_id=c0c65297-ae3b-41aa-830b-1e7cfc340dcf)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Creating volume 124e3725-78ad-421c-bebc-99c83e2eb985 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:25 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 1073741824 Sep 23 00:19:25 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b84c6d-11ae-4ca3-a4c9-039988e46054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8b53fa-de25-44a2-b295-458b687fcf0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978857b3-9b0c-4652-a19c-707a99b46147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume volume-ab8b53fa-de25-44a2-b295-458b687fcf0c (ab8b53fa-de25-44a2-b295-458b687fcf0c): created successfully Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978857b3-9b0c-4652-a19c-707a99b46147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (fe691633-e4f7-4e14-93e3-b7c4c5a328c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4e186ccf-c537-4875-b9fa-1166e8eb8620 tempest-TestInstancesWithCinderVolumes-129016560 None] Created volume successfully. Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (b2a2d038-1727-4eb3-bed7-a55b9b4fd9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba59681-a521-4747-810b-6b29c0bb34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba59681-a521-4747-810b-6b29c0bb34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-203708086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e369f607-8641-4205-a05d-6310a1cbfe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:26Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6028f2ec-7d14-41b1-9697-6f5088acff2c),volume_type_id=6028f2ec-7d14-41b1-9697-6f5088acff2c)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe189bb-04c0-49e4-84b8-d25c4e850852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe189bb-04c0-49e4-84b8-d25c4e850852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3dc93a-4637-4b25-930c-384ff27c5ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:19:26 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 1073741824" returned: 0 in 0.794s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:26 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 Sep 23 00:19:26 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3dc93a-4637-4b25-930c-384ff27c5ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e369f607-8641-4205-a05d-6310a1cbfe34', 'volume_name': 'volume-e369f607-8641-4205-a05d-6310a1cbfe34', 'volume_size': 1, 'image_id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--76010176', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1da1a343607d47e38b837268240b2cf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999c86d6-7781-49c1-b3a7-d81688f96423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999c86d6-7781-49c1-b3a7-d81688f96423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07630c5-0156-4df0-a484-04f4bcec940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume e369f607-8641-4205-a05d-6310a1cbfe34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e369f607-8641-4205-a05d-6310a1cbfe34', 'volume_size': 1, 'image_id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--76010176', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1da1a343607d47e38b837268240b2cf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf/file', 'properties': {}}, 'image_service': } Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Trying to clone e369f607-8641-4205-a05d-6310a1cbfe34 from image 9848bac4-5e0e-4793-be4a-63d253c7b6cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:19:26 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.974s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Creating offline snapshot 75b8c423-5e30-4aea-9a24-d07f22f2cf9d of volume d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbe3177-bb2e-4ba9-bc37-19d38c246831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124e3725-78ad-421c-bebc-99c83e2eb985', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e8133f-7378-4769-847a-04a055b4fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43a842-aa6d-48e8-902a-7b38bb52fdc1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume volume-124e3725-78ad-421c-bebc-99c83e2eb985 (124e3725-78ad-421c-bebc-99c83e2eb985): created successfully Sep 23 00:19:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e8133f-7378-4769-847a-04a055b4fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (a5309d04-08b4-4f89-890e-14571c7bffb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-96fe9794-c85c-4064-be9b-d8e4fe50db80 tempest-TestInstancesWithCinderVolumes-129016560 None] Created volume successfully. Sep 23 00:19:27 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e Sep 23 00:19:27 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:27 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e" returned: 0 in 0.693s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:27 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d 1G Sep 23 00:19:27 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:28 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d 1G" returned: 0 in 0.596s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d492ef3f-1230-44ee-86b8-b1d338d2336e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d492ef3f-1230-44ee-86b8-b1d338d2336e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d Sep 23 00:19:28 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:28 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d492ef3f-1230-44ee-86b8-b1d338d2336e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:28 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d is being set with open permissions: ugo+rw Sep 23 00:19:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:28 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d Sep 23 00:19:28 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info Sep 23 00:19:29 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info is being set with open permissions: ugo+rw Sep 23 00:19:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info Sep 23 00:19:29 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:30 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.info" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b524bcd5-569d-475a-9632-134eebbf6513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Create snapshot completed successfully Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "cinder-75b8c423-5e30-4aea-9a24-d07f22f2cf9d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-75b8c423-5e30-4aea-9a24-d07f22f2cf9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "cinder-quobyte-75b8c423-5e30-4aea-9a24-d07f22f2cf9d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-75b8c423-5e30-4aea-9a24-d07f22f2cf9d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Deleting offline snapshot 75b8c423-5e30-4aea-9a24-d07f22f2cf9d of volume d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] snapshot_file for this snap is: volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e747222-89f0-4c3e-929f-9c26e1a4282f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d Sep 23 00:19:32 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD, size 20.69 MB, duration 5.89 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:19:32 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Image download 20.69 MB at 3.51 MB/s Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ab0ef-f91a-486f-81c2-6302ed590ac2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d" returned: 0 in 0.603s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d492ef3f-1230-44ee-86b8-b1d338d2336e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7494d183-ae1a-4175-a3e8-4c7a8f09634f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD Sep 23 00:19:32 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-f27784dc-77df-4f58-9719-76f4c30d1e14 req-04e8ffcb-5369-4d43-a0c3-eeb81003c4c6 tempest-AttachVolumeTestJSON-20470943 None] Terminate volume connection completed successfully. Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-f27784dc-77df-4f58-9719-76f4c30d1e14 req-04e8ffcb-5369-4d43-a0c3-eeb81003c4c6 tempest-AttachVolumeTestJSON-20470943 None] Deleting attachment c1059905-ff62-4e32-9c8d-c1397bcbf704. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:32 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e Sep 23 00:19:32 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Temporary image 9848bac4-5e0e-4793-be4a-63d253c7b6cf is fetched for user 8a122969e0ce41a5abe5a3b60e0ea9d4. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bec579-e070-4dcf-b0f0-ab5b1a019e59]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d Sep 23 00:19:33 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD Sep 23 00:19:33 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-203708086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e369f607-8641-4205-a05d-6310a1cbfe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da1a343607d47e38b837268240b2cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:26Z,use_quota=True,user_id='8a122969e0ce41a5abe5a3b60e0ea9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6028f2ec-7d14-41b1-9697-6f5088acff2c),volume_type_id=6028f2ec-7d14-41b1-9697-6f5088acff2c)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Creating volume e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1073741824 Sep 23 00:19:33 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d" returned: 0 in 0.597s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d Sep 23 00:19:33 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:34 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e.75b8c423-5e30-4aea-9a24-d07f22f2cf9d" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-75b8c423-5e30-4aea-9a24-d07f22f2cf9d" released by "_delete_snapshot" :: held 2.329s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" released by "delete_snapshot" :: held 2.372s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Created reservations ['0e30694a-e161-4ee0-aa2b-2215f8800844', '2ab422b1-97e1-422c-81bd-abd20671d44d', 'b222dd5c-dc1f-4beb-8263-40c519838ce0', '487abeae-be01-4108-8010-28672bc31170', 'f7b2067c-7a03-483f-9fa2-5684ced770d1'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:19:34 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1073741824" returned: 0 in 0.767s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 Sep 23 00:19:34 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Delete snapshot completed successfully. Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3e9d71d-bc7c-4681-8949-fad5bd34b54a tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-75b8c423-5e30-4aea-9a24-d07f22f2cf9d-delete_snapshot" released by "delete_snapshot" :: held 2.663s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:34 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Attempting download of 9848bac4-5e0e-4793-be4a-63d253c7b6cf ((None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}])) to volume e369f607-8641-4205-a05d-6310a1cbfe34. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4dd05f-34e3-46cc-a1f5-22a3065c6bba]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4 Sep 23 00:19:34 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "cinder-d492ef3f-1230-44ee-86b8-b1d338d2336e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-d492ef3f-1230-44ee-86b8-b1d338d2336e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8f1f0-7967-489a-8d96-5d26fcbe0b9f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4 Sep 23 00:19:35 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e Sep 23 00:19:35 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4" returned: 1 in 0.573s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9848bac4-5e0e-4793-be4a-63d253c7b6cf_lq4bz4k4' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac9246-5823-44bc-9932-acee0001c0c8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD Sep 23 00:19:36 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e" returned: 0 in 0.843s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e Sep 23 00:19:36 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] 9848bac4-5e0e-4793-be4a-63d253c7b6cf was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 Sep 23 00:19:36 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d492ef3f-1230-44ee-86b8-b1d338d2336e" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-quobyte-d492ef3f-1230-44ee-86b8-b1d338d2336e" released by "delete_volume" :: held 1.486s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Created reservations ['bf0a606b-d1d7-4fdb-bd88-8ccc56cdcff6', '1c76badc-ec19-45a5-813d-fee16ab31369', '1b66c436-5f70-4ff9-9b2f-b7e94ef3dad6', '0a219411-0a01-41b1-9438-2fbb093c89fa', '57b92f4d-1927-49c5-b133-608d8533cc27'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:19:36 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:19:37 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.629s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Deleted volume successfully. Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d600a4f-d5c6-4dae-85bc-34eb0193da88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1567620389 None] Lock "cinder-d492ef3f-1230-44ee-86b8-b1d338d2336e-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:37 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:40 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34" returned: 0 in 3.827s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9848bac4-5e0e-4793-be4a-63d253c7b6cf_ivvknfhedevstack@QuobyteHD, size 112.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:40 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Converted 112.00 MB image at 29.26 MB/s Sep 23 00:19:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1G Sep 23 00:19:40 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 1G" returned: 0 in 0.821s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Downloaded image 9848bac4-5e0e-4793-be4a-63d253c7b6cf ((None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}])) to volume e369f607-8641-4205-a05d-6310a1cbfe34 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Temporary image 9848bac4-5e0e-4793-be4a-63d253c7b6cf for user 8a122969e0ce41a5abe5a3b60e0ea9d4 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Marking volume e369f607-8641-4205-a05d-6310a1cbfe34 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Copying metadata from image 9848bac4-5e0e-4793-be4a-63d253c7b6cf to e369f607-8641-4205-a05d-6310a1cbfe34. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Creating volume glance metadata for volume e369f607-8641-4205-a05d-6310a1cbfe34 backed by image 9848bac4-5e0e-4793-be4a-63d253c7b6cf with: {'image_id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'image_name': 'tempest-scenario-img--76010176', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07630c5-0156-4df0-a484-04f4bcec940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e369f607-8641-4205-a05d-6310a1cbfe34', 'volume_size': 1, 'image_id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--76010176', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1da1a343607d47e38b837268240b2cf3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9848bac4-5e0e-4793-be4a-63d253c7b6cf', 'created_at': datetime.datetime(2026, 9, 22, 22, 19, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 19, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9848bac4-5e0e-4793-be4a-63d253c7b6cf/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f671de6b-64a8-47d4-8e4b-dc5d2100f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Volume volume-e369f607-8641-4205-a05d-6310a1cbfe34 (e369f607-8641-4205-a05d-6310a1cbfe34): created successfully Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f671de6b-64a8-47d4-8e4b-dc5d2100f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Flow 'volume_create_manager' (b2a2d038-1727-4eb3-bed7-a55b9b4fd9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-06af146d-4082-4c92-b754-c0eddd766a44 tempest-TestInstancesWithCinderVolumes-129016560 None] Created volume successfully. Sep 23 00:19:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e0fadca4-8880-4f2a-ab9d-800bcb7fac7b req-1ce14154-c627-4156-aae9-924b20f6d0f2 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e0fadca4-8880-4f2a-ab9d-800bcb7fac7b req-1ce14154-c627-4156-aae9-924b20f6d0f2 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e0fadca4-8880-4f2a-ab9d-800bcb7fac7b req-1ce14154-c627-4156-aae9-924b20f6d0f2 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-e0fadca4-8880-4f2a-ab9d-800bcb7fac7b req-1ce14154-c627-4156-aae9-924b20f6d0f2 tempest-TestInstancesWithCinderVolumes-129016560 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-e369f607-8641-4205-a05d-6310a1cbfe34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7367fe1e-fbc5-442d-9771-faf23fe47d51', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:19:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-e0fadca4-8880-4f2a-ab9d-800bcb7fac7b req-1ce14154-c627-4156-aae9-924b20f6d0f2 tempest-TestInstancesWithCinderVolumes-129016560 None] attachment_update completed successfully. Sep 23 00:19:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=51,cinder:UPDATE=50,cinder:DELETE=6,cinder:INSERT=21 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:37 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:20:37 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:37 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.549s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-90a50fda-8ff7-47a6-a2bb-01f821112f3e req-4ab3de5b-3ee0-4675-81bc-4ae187826059 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-90a50fda-8ff7-47a6-a2bb-01f821112f3e req-4ab3de5b-3ee0-4675-81bc-4ae187826059 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-90a50fda-8ff7-47a6-a2bb-01f821112f3e req-4ab3de5b-3ee0-4675-81bc-4ae187826059 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.075s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-90a50fda-8ff7-47a6-a2bb-01f821112f3e req-4ab3de5b-3ee0-4675-81bc-4ae187826059 tempest-TestInstancesWithCinderVolumes-129016560 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-ab8b53fa-de25-44a2-b295-458b687fcf0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6caabd1-6b76-4282-a09a-450f2eb165a4', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-90a50fda-8ff7-47a6-a2bb-01f821112f3e req-4ab3de5b-3ee0-4675-81bc-4ae187826059 tempest-TestInstancesWithCinderVolumes-129016560 None] attachment_update completed successfully. Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (762ff0c9-8d2b-4abc-b443-66f39218ede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850bdc39-c936-4336-ae92-8928837cd626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850bdc39-c936-4336-ae92-8928837cd626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-721863868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f531b85-c1e2-4f0f-a706-6b7b86d0a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:48Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ec4da-78ea-40e6-937d-8e05f27669fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3ec4da-78ea-40e6-937d-8e05f27669fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3718ca8-1da6-4c28-86a4-cfcbb2409c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3718ca8-1da6-4c28-86a4-cfcbb2409c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f531b85-c1e2-4f0f-a706-6b7b86d0a33c', 'volume_name': 'volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d818123d-1402-4cdc-8bea-8e4bd1c7ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d818123d-1402-4cdc-8bea-8e4bd1c7ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff032b8-f980-4f20-bfd2-7be2fb15db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Volume 6f531b85-c1e2-4f0f-a706-6b7b86d0a33c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c', 'volume_size': 1} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-721863868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f531b85-c1e2-4f0f-a706-6b7b86d0a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:48Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Creating volume 6f531b85-c1e2-4f0f-a706-6b7b86d0a33c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:20:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c 1073741824 Sep 23 00:20:48 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9e04b9b2-3f3b-4aef-8608-a2d2c877517b req-4a0df93d-fee9-4a9b-af7e-3126a4293f14 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:50 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c 1073741824" returned: 0 in 1.511s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:50 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c Sep 23 00:20:50 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:50 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" returned: 0 in 0.607s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9e04b9b2-3f3b-4aef-8608-a2d2c877517b req-4a0df93d-fee9-4a9b-af7e-3126a4293f14 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.789s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff032b8-f980-4f20-bfd2-7be2fb15db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98e8cf9-8560-4c84-ab7f-d77d9cf76a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9e04b9b2-3f3b-4aef-8608-a2d2c877517b req-4a0df93d-fee9-4a9b-af7e-3126a4293f14 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Volume volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c (6f531b85-c1e2-4f0f-a706-6b7b86d0a33c): created successfully Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98e8cf9-8560-4c84-ab7f-d77d9cf76a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (762ff0c9-8d2b-4abc-b443-66f39218ede6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-756c1f1b-6d04-4fc3-be70-c717f3d17eec tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9e04b9b2-3f3b-4aef-8608-a2d2c877517b req-4a0df93d-fee9-4a9b-af7e-3126a4293f14 tempest-TestInstancesWithCinderVolumes-129016560 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-124e3725-78ad-421c-bebc-99c83e2eb985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de23f112-bf3b-42a4-ba23-07ce550484a3', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:20:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9e04b9b2-3f3b-4aef-8608-a2d2c877517b req-4a0df93d-fee9-4a9b-af7e-3126a4293f14 tempest-TestInstancesWithCinderVolumes-129016560 None] attachment_update completed successfully. Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2a5c8131-e117-4af6-82a1-f0d9304799dd tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2a5c8131-e117-4af6-82a1-f0d9304799dd tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" acquired by "attach_volume" :: waited 0.059s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2a5c8131-e117-4af6-82a1-f0d9304799dd tempest-VolumesActionsTest-1747221907 None] Attaching volume 6f531b85-c1e2-4f0f-a706-6b7b86d0a33c to instance 253efd0e-7639-4e41-ba4b-7e3ade39d685 at mountpoint /dev/vdb on host None. Sep 23 00:20:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2a5c8131-e117-4af6-82a1-f0d9304799dd tempest-VolumesActionsTest-1747221907 None] Attach volume completed successfully. Sep 23 00:20:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2a5c8131-e117-4af6-82a1-f0d9304799dd tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" released by "attach_volume" :: held 0.309s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Terminate volume connection completed successfully. Sep 23 00:20:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Detaching volume 6f531b85-c1e2-4f0f-a706-6b7b86d0a33c from instance 253efd0e-7639-4e41-ba4b-7e3ade39d685. Sep 23 00:20:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Detach volume completed successfully. Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-30632fa2-5a26-4b70-b9a0-09b585d93c38 tempest-VolumesActionsTest-845761425 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" released by "detach_volume" :: held 0.222s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55de5c14-ffc2-4b4e-8a80-3653859168c3 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55de5c14-ffc2-4b4e-8a80-3653859168c3 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-55de5c14-ffc2-4b4e-8a80-3653859168c3 tempest-VolumesActionsTest-1747221907 None] Volume detach called, but volume not attached. Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55de5c14-ffc2-4b4e-8a80-3653859168c3 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-quobyte-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-quobyte-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[35374263-fd02-4255-a206-db7b837cd73d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c Sep 23 00:20:55 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c Sep 23 00:20:55 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-quobyte-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c" released by "delete_volume" :: held 1.090s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Created reservations ['fea0ec99-cf2d-4658-8987-2918d08a35a1', '69a0bba6-ab08-45c0-9820-d1ffe80d3b67', '66e872ab-6817-4d0c-a850-3b5d44aa3450', 'd5fce7c2-780a-4d19-abbe-fb0ddad52ef9', 'b371b90f-5250-4671-93db-f9f36298cd05'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:56 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:20:56 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Deleted volume successfully. Sep 23 00:20:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7dd769d3-5e82-4bbb-9987-6038259dc242 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-6f531b85-c1e2-4f0f-a706-6b7b86d0a33c-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-8cd37e04-6b17-4f6e-a79d-c318538b0dcd req-cbb53d9d-76a9-445b-84c1-625a6d057e15 tempest-TestInstancesWithCinderVolumes-129016560 None] Terminate volume connection completed successfully. Sep 23 00:20:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-8cd37e04-6b17-4f6e-a79d-c318538b0dcd req-cbb53d9d-76a9-445b-84c1-625a6d057e15 tempest-TestInstancesWithCinderVolumes-129016560 None] Deleting attachment f6caabd1-6b76-4282-a09a-450f2eb165a4. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-ab8b53fa-de25-44a2-b295-458b687fcf0c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-ab8b53fa-de25-44a2-b295-458b687fcf0c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-quobyte-ab8b53fa-de25-44a2-b295-458b687fcf0c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-ab8b53fa-de25-44a2-b295-458b687fcf0c" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afe46a3-e3c2-47f5-aac1-c67f6bb508de]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:00 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c Sep 23 00:21:00 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:01 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c" returned: 0 in 0.887s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c Sep 23 00:21:01 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:01 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ab8b53fa-de25-44a2-b295-458b687fcf0c" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-ab8b53fa-de25-44a2-b295-458b687fcf0c" released by "delete_volume" :: held 1.317s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:01 devstack cinder-volume[86731]: WARNING cinder.quota [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536143645-1690622328 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536143645-1690622328, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:01 devstack cinder-volume[86731]: WARNING cinder.quota [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536143645-1690622328 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-536143645-1690622328, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Created reservations ['5fa836d6-a73a-434c-bccf-290ba86c9290', '565a1ef0-ea22-4e23-b43b-ed96a8df87cc', 'fe332eaa-8cbd-46e1-b665-67268db58e4d', '857381cd-e7c2-4d6e-9524-7b70d4ef15a5', 'f345ac13-7b57-4fc8-bbaa-7ad1cf4a70d1'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:01 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Deleted volume successfully. Sep 23 00:21:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e3506fd-b322-452f-bdc0-1c932f007108 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-ab8b53fa-de25-44a2-b295-458b687fcf0c-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (94e0e168-dcc1-4cd9-bd6c-80d6a7cf99da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd05a8c-d982-4b36-ac08-5a15188f79e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd05a8c-d982-4b36-ac08-5a15188f79e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-540801272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d561a151-b2b6-468c-a926-8090d38678d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:03Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa90f6-d975-4246-abf5-8e6c44f5aa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa90f6-d975-4246-abf5-8e6c44f5aa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55bc408-a91d-43bd-9f31-8b6e932e7093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55bc408-a91d-43bd-9f31-8b6e932e7093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd561a151-b2b6-468c-a926-8090d38678d1', 'volume_name': 'volume-d561a151-b2b6-468c-a926-8090d38678d1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee971b3-88dc-4d98-b8ef-5d6789167512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee971b3-88dc-4d98-b8ef-5d6789167512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878804a3-abcb-4530-aecd-c360752635e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Volume d561a151-b2b6-468c-a926-8090d38678d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d561a151-b2b6-468c-a926-8090d38678d1', 'volume_size': 1} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-540801272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d561a151-b2b6-468c-a926-8090d38678d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:03Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Creating volume d561a151-b2b6-468c-a926-8090d38678d1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:03 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 1073741824 Sep 23 00:21:03 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Flow 'volume_create_manager' (15057396-a8fb-48ce-b875-35c55a96e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1657fd6-84ae-44d2-b7d2-bf0c57427af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1657fd6-84ae-44d2-b7d2-bf0c57427af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-568399605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf1ed20-e675-4deb-9260-7a9d50020fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200b85cb1dea4ba181c765091b342dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:04Z,use_quota=True,user_id='efbd929d5bfe4625bb036e8e11e6199a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7829f4-2720-43b4-ad1f-f269950cebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7829f4-2720-43b4-ad1f-f269950cebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59974cf-9e5e-4440-aa21-f8686f492089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59974cf-9e5e-4440-aa21-f8686f492089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf1ed20-e675-4deb-9260-7a9d50020fd6', 'volume_name': 'volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6059ff-6dd9-486f-9167-a48a6a516900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6059ff-6dd9-486f-9167-a48a6a516900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36a8a4-ac46-43c1-b34b-df81394c0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Volume dbf1ed20-e675-4deb-9260-7a9d50020fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6', 'volume_size': 1} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:04 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 1073741824" returned: 0 in 0.831s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 Sep 23 00:21:04 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:04 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-568399605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf1ed20-e675-4deb-9260-7a9d50020fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200b85cb1dea4ba181c765091b342dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:04Z,use_quota=True,user_id='efbd929d5bfe4625bb036e8e11e6199a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Creating volume dbf1ed20-e675-4deb-9260-7a9d50020fd6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 1073741824 Sep 23 00:21:04 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878804a3-abcb-4530-aecd-c360752635e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d561a151-b2b6-468c-a926-8090d38678d1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe92b58-3290-47f8-9e0f-85e1ab2ca303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Volume volume-d561a151-b2b6-468c-a926-8090d38678d1 (d561a151-b2b6-468c-a926-8090d38678d1): created successfully Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe92b58-3290-47f8-9e0f-85e1ab2ca303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (94e0e168-dcc1-4cd9-bd6c-80d6a7cf99da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7d22dec3-5449-41fa-ab80-bdd6dd60155f tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:21:05 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 1073741824" returned: 0 in 0.570s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 Sep 23 00:21:05 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-d561a151-b2b6-468c-a926-8090d38678d1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "cinder-d561a151-b2b6-468c-a926-8090d38678d1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-quobyte-d561a151-b2b6-468c-a926-8090d38678d1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-d561a151-b2b6-468c-a926-8090d38678d1" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36a8a4-ac46-43c1-b34b-df81394c0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6252e403-6942-4d95-9e75-2b833494457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66b67ec-b0bc-4736-ab14-60328468ede2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Volume volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 (dbf1ed20-e675-4deb-9260-7a9d50020fd6): created successfully Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6252e403-6942-4d95-9e75-2b833494457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Flow 'volume_create_manager' (15057396-a8fb-48ce-b875-35c55a96e86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-94e09ea2-2576-426c-a071-d3f34bc97b98 tempest-AttachVolumeShelveTestJSON-102712789 None] Created volume successfully. Sep 23 00:21:06 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 Sep 23 00:21:06 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-20a4ece9-a012-4e7f-b7f7-1990c7e4e42f req-af9cd355-5b0b-4fe0-99e2-bc38cafe2b6c tempest-TestInstancesWithCinderVolumes-129016560 None] Terminate volume connection completed successfully. Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-20a4ece9-a012-4e7f-b7f7-1990c7e4e42f req-af9cd355-5b0b-4fe0-99e2-bc38cafe2b6c tempest-TestInstancesWithCinderVolumes-129016560 None] Deleting attachment de23f112-bf3b-42a4-ba23-07ce550484a3. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:06 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1 Sep 23 00:21:06 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d561a151-b2b6-468c-a926-8090d38678d1" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-d561a151-b2b6-468c-a926-8090d38678d1" released by "delete_volume" :: held 0.962s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Created reservations ['b31aa29d-ef55-4675-ae3d-7a3b2b6c57d2', '1df0a009-ec49-416a-a859-e56ea1521c1b', '8b4243a3-9ace-4909-adb4-2312024d7907', '560f6354-dfa3-433d-800f-4f065471f659', '817b1891-3c8d-4276-b8f4-1d4dbbeb8ee2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:06 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-124e3725-78ad-421c-bebc-99c83e2eb985-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-124e3725-78ad-421c-bebc-99c83e2eb985-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-quobyte-124e3725-78ad-421c-bebc-99c83e2eb985" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-124e3725-78ad-421c-bebc-99c83e2eb985" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5ef97e-9c12-4bc6-b87e-7321f2190bbe]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:07 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Deleted volume successfully. Sep 23 00:21:07 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 Sep 23 00:21:07 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5cd98d8-6359-466b-8f38-02b14572a272 tempest-VolumesActionsTest-845761425 None] Lock "cinder-d561a151-b2b6-468c-a926-8090d38678d1-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:07 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985" returned: 0 in 0.545s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:07 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985 Sep 23 00:21:07 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:08 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-124e3725-78ad-421c-bebc-99c83e2eb985" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-124e3725-78ad-421c-bebc-99c83e2eb985" released by "delete_volume" :: held 0.978s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:08 devstack cinder-volume[86731]: WARNING cinder.quota [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-626673272-1709559430 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-626673272-1709559430, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:08 devstack cinder-volume[86731]: WARNING cinder.quota [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-626673272-1709559430 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-626673272-1709559430, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Created reservations ['68217bad-3808-4c0a-9947-77e75ff98dd2', '8f77c41c-acb0-4bf9-b450-73832792998e', '81212406-491a-4f81-9894-d1e868364397', '45077910-b992-46df-8a07-ee112b07bc02', 'cb878b6f-2dad-44f9-a6c7-26aabfa479cb'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:21:08 devstack cinder-volume[86731]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:21:08 devstack cinder-volume[86731]: FROM reservations Sep 23 00:21:08 devstack cinder-volume[86731]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:21:08 devstack cinder-volume[86731]: [parameters: {'uuid_1_1': '68217bad-3808-4c0a-9947-77e75ff98dd2', 'uuid_1_2': '8f77c41c-acb0-4bf9-b450-73832792998e', 'uuid_1_3': '81212406-491a-4f81-9894-d1e868364397', 'uuid_1_4': '45077910-b992-46df-8a07-ee112b07bc02', 'uuid_1_5': 'cb878b6f-2dad-44f9-a6c7-26aabfa479cb'}] Sep 23 00:21:08 devstack cinder-volume[86731]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86731) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86731) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (6152524f-0a64-4118-a361-82dde95dff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26e579c-3677-47d7-8d9d-ad15e59dd34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26e579c-3677-47d7-8d9d-ad15e59dd34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131219412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f5818d-59fb-480d-9679-8ad1409454f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:09Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a11729-b801-42e6-87bb-55d2b663f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a11729-b801-42e6-87bb-55d2b663f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16af83ab-831f-4f73-ba79-cf83a2c500f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16af83ab-831f-4f73-ba79-cf83a2c500f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f5818d-59fb-480d-9679-8ad1409454f0', 'volume_name': 'volume-95f5818d-59fb-480d-9679-8ad1409454f0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6aa14d-3c98-44b7-b674-7196482ac50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6aa14d-3c98-44b7-b674-7196482ac50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd096952-2c75-4158-9cf9-ed61aa4d79a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Volume 95f5818d-59fb-480d-9679-8ad1409454f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f5818d-59fb-480d-9679-8ad1409454f0', 'volume_size': 1} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131219412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f5818d-59fb-480d-9679-8ad1409454f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:09Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Creating volume 95f5818d-59fb-480d-9679-8ad1409454f0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:09 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 1073741824 Sep 23 00:21:09 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:09 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:09 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 1073741824" returned: 0 in 0.825s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:09 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:09 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 Sep 23 00:21:09 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Deleted volume successfully. Sep 23 00:21:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34f44232-065c-4dad-b711-434eaa95e913 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-124e3725-78ad-421c-bebc-99c83e2eb985-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:10 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd096952-2c75-4158-9cf9-ed61aa4d79a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f5818d-59fb-480d-9679-8ad1409454f0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aded89d-ba00-4468-877f-3ad77c5f0090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Volume volume-95f5818d-59fb-480d-9679-8ad1409454f0 (95f5818d-59fb-480d-9679-8ad1409454f0): created successfully Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aded89d-ba00-4468-877f-3ad77c5f0090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (6152524f-0a64-4118-a361-82dde95dff4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-baed4dbd-d19a-49e0-b388-ca7b874f50a2 tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-95f5818d-59fb-480d-9679-8ad1409454f0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "cinder-95f5818d-59fb-480d-9679-8ad1409454f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-quobyte-95f5818d-59fb-480d-9679-8ad1409454f0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-95f5818d-59fb-480d-9679-8ad1409454f0" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c4f23-9618-4a77-9a27-3eb2d8afd077]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:12 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 Sep 23 00:21:12 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:12 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0" returned: 0 in 0.962s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:12 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0 Sep 23 00:21:12 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:13 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-95f5818d-59fb-480d-9679-8ad1409454f0" returned: 0 in 0.531s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-95f5818d-59fb-480d-9679-8ad1409454f0" released by "delete_volume" :: held 1.687s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Created reservations ['b3f83105-7ee8-4b7c-b301-2eacd348fa20', '4b000141-901f-441f-9f1e-110c1fccd304', '82cfda9d-5ba5-4c64-a6ec-4f5dab0822f7', '76e6bf96-7207-418f-8a2c-81c2d0246b80', '846e9f71-c7e8-4355-bb67-7ddff0200351'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:13 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:13 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-3921cc57-9a66-4ef3-8bc2-be334a851ceb req-c8ae362a-bd7b-4143-8483-32924e47c9d9 tempest-TestInstancesWithCinderVolumes-129016560 None] Terminate volume connection completed successfully. Sep 23 00:21:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-3921cc57-9a66-4ef3-8bc2-be334a851ceb req-c8ae362a-bd7b-4143-8483-32924e47c9d9 tempest-TestInstancesWithCinderVolumes-129016560 None] Deleting attachment 7367fe1e-fbc5-442d-9771-faf23fe47d51. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:14 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.816s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:14 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Deleted volume successfully. Sep 23 00:21:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c80b3b93-2527-4691-9a18-3ca61c35b6e9 tempest-VolumesActionsTest-845761425 None] Lock "cinder-95f5818d-59fb-480d-9679-8ad1409454f0-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (7048a855-34fa-4edb-aac9-e38228dec23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897d38d4-8b1a-428b-b09b-774359192696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897d38d4-8b1a-428b-b09b-774359192696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857423858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c38705-4ad6-401e-9e23-1e9bc803cbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:15Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822ebd9b-2f9d-47e4-92b7-9b618596bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822ebd9b-2f9d-47e4-92b7-9b618596bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca102df3-3182-422d-9c25-d400dd45653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca102df3-3182-422d-9c25-d400dd45653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c38705-4ad6-401e-9e23-1e9bc803cbc1', 'volume_name': 'volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b10bfd-0e7a-42c0-a86f-520805c37d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b10bfd-0e7a-42c0-a86f-520805c37d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918e982c-80b5-4b8c-a338-f1e1ec6385e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Volume e2c38705-4ad6-401e-9e23-1e9bc803cbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1', 'volume_size': 1} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857423858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c38705-4ad6-401e-9e23-1e9bc803cbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:15Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Creating volume e2c38705-4ad6-401e-9e23-1e9bc803cbc1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:15 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:15 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 1073741824 Sep 23 00:21:15 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:15 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 1073741824" returned: 0 in 0.620s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:16 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 Sep 23 00:21:16 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-e369f607-8641-4205-a05d-6310a1cbfe34-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-e369f607-8641-4205-a05d-6310a1cbfe34-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "cinder-quobyte-e369f607-8641-4205-a05d-6310a1cbfe34" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-e369f607-8641-4205-a05d-6310a1cbfe34" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bd91a9-32c0-4154-8bdd-129e5e1adbcb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:16 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" returned: 0 in 0.524s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:16 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 Sep 23 00:21:16 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918e982c-80b5-4b8c-a338-f1e1ec6385e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c3da72-1006-44ac-bc07-f500274d01cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Volume volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 (e2c38705-4ad6-401e-9e23-1e9bc803cbc1): created successfully Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c3da72-1006-44ac-bc07-f500274d01cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (7048a855-34fa-4edb-aac9-e38228dec23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f7985900-6d25-4828-9805-72d5db8b286a tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (9102b548-7162-40d7-b349-37c8136c3121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d3b8e5-10be-4620-8295-5560af750c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d3b8e5-10be-4620-8295-5560af750c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1882786369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6559dd13-418b-47d6-8bd7-ba27539c9094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:17Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b8472a-4452-463b-b282-5a7b1ba14064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b8472a-4452-463b-b282-5a7b1ba14064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7791a00a-f8a4-421a-b0fe-88152ca6cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7791a00a-f8a4-421a-b0fe-88152ca6cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6559dd13-418b-47d6-8bd7-ba27539c9094', 'volume_name': 'volume-6559dd13-418b-47d6-8bd7-ba27539c9094', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f541490-ba0e-444b-8cbf-2220a2873c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f541490-ba0e-444b-8cbf-2220a2873c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe679c3-bcc6-4589-a4fe-dc0bbc0343ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Volume 6559dd13-418b-47d6-8bd7-ba27539c9094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6559dd13-418b-47d6-8bd7-ba27539c9094', 'volume_size': 1} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1882786369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6559dd13-418b-47d6-8bd7-ba27539c9094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:17Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Creating volume 6559dd13-418b-47d6-8bd7-ba27539c9094 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:16 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 1073741824 Sep 23 00:21:16 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:16 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34" returned: 0 in 0.510s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:16 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34 Sep 23 00:21:16 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:17 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e369f607-8641-4205-a05d-6310a1cbfe34" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-quobyte-e369f607-8641-4205-a05d-6310a1cbfe34" released by "delete_volume" :: held 0.984s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251134072-1670021627 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251134072-1670021627, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251134072-1670021627 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-251134072-1670021627, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Created reservations ['41654369-8057-4a6d-af90-b2e8ad0e909a', 'ec5a0d84-a9cb-4371-bdb5-f570d0a5c209', '8385686e-97e3-4378-aec1-9ed37f9e88ab', '72353137-e213-4bb6-8ec1-3d14841e63e2', 'a2f1ef2c-d649-48eb-aa48-c306be7916a0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 1073741824" returned: 0 in 0.690s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:17 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-e2c38705-4ad6-401e-9e23-1e9bc803cbc1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "cinder-e2c38705-4ad6-401e-9e23-1e9bc803cbc1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:17 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 Sep 23 00:21:17 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:17 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:17 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-quobyte-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b41217-1c94-4415-b64b-19f6f9ff0b57]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:18 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 Sep 23 00:21:18 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:18 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094" returned: 0 in 0.561s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe679c3-bcc6-4589-a4fe-dc0bbc0343ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6559dd13-418b-47d6-8bd7-ba27539c9094', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c209827-89ba-48e9-a81b-1059aaa53645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Volume volume-6559dd13-418b-47d6-8bd7-ba27539c9094 (6559dd13-418b-47d6-8bd7-ba27539c9094): created successfully Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c209827-89ba-48e9-a81b-1059aaa53645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:18 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (9102b548-7162-40d7-b349-37c8136c3121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.587s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Deleted volume successfully. Sep 23 00:21:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ad5bbd64-1463-4fa1-bbe8-106b8b454343 tempest-AttachVolumeTestJSON-20470943 None] Created volume successfully. Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d625d67-5081-4cf3-bc7e-88ef758f8649 tempest-TestInstancesWithCinderVolumes-129016560 None] Lock "cinder-e369f607-8641-4205-a05d-6310a1cbfe34-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:18 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" returned: 0 in 0.626s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:18 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1 Sep 23 00:21:18 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:18 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-e2c38705-4ad6-401e-9e23-1e9bc803cbc1" released by "delete_volume" :: held 1.086s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:18 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Created reservations ['5f13e1ae-36c2-4be7-832a-cc7ce33cf814', '1f71a86b-0a96-4408-9d39-a4efe9e3c62f', '6c1bdbad-66d9-409f-96e6-a8712bec0a8e', '8924dda9-982e-42f7-b0e1-e1772defff1d', 'ba418297-1402-4822-bd0e-5eccb44fd6b6'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:19 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:19 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:19 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Deleted volume successfully. Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1b42ce78-4e0f-4f82-b457-41274a748698 tempest-VolumesActionsTest-845761425 None] Lock "cinder-e2c38705-4ad6-401e-9e23-1e9bc803cbc1-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e94af544-7ac5-445b-9bd4-1cc995a4b60f req-db91c8d6-3189-4761-a6a3-cb24fe25e7ab tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e94af544-7ac5-445b-9bd4-1cc995a4b60f req-db91c8d6-3189-4761-a6a3-cb24fe25e7ab tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e94af544-7ac5-445b-9bd4-1cc995a4b60f req-db91c8d6-3189-4761-a6a3-cb24fe25e7ab tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-e94af544-7ac5-445b-9bd4-1cc995a4b60f req-db91c8d6-3189-4761-a6a3-cb24fe25e7ab tempest-AttachVolumeTestJSON-20470943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-6559dd13-418b-47d6-8bd7-ba27539c9094', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '975d8f57-a960-401a-9d6e-0d82c7231477', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-e94af544-7ac5-445b-9bd4-1cc995a4b60f req-db91c8d6-3189-4761-a6a3-cb24fe25e7ab tempest-AttachVolumeTestJSON-20470943 None] attachment_update completed successfully. Sep 23 00:21:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2c83db9b-0954-465d-957d-2c263b4cf0e5 req-b6e6a17d-2bca-4209-b35c-6ce5ec7ba0b3 tempest-AttachVolumeShelveTestJSON-102712789 None] No connector for attachment f3be521c-0d30-4a91-a942-a9a14a3f0519; skipping storage backend terminate_connection call. {{(pid=86731) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:21:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2c83db9b-0954-465d-957d-2c263b4cf0e5 req-b6e6a17d-2bca-4209-b35c-6ce5ec7ba0b3 tempest-AttachVolumeShelveTestJSON-102712789 None] Deleting attachment f3be521c-0d30-4a91-a942-a9a14a3f0519. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (6bc8b94a-4076-405a-beea-5957002f8647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996ee87e-8694-4db5-b41b-7850ce10023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996ee87e-8694-4db5-b41b-7850ce10023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569701718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8cff00-8fce-43e0-bd99-1f14e1d46b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:21Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd25042f-26d0-4f3a-9313-0702fe3a23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd25042f-26d0-4f3a-9313-0702fe3a23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f04c23-e8de-4924-9762-29edff23fcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f04c23-e8de-4924-9762-29edff23fcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8cff00-8fce-43e0-bd99-1f14e1d46b17', 'volume_name': 'volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e99e9a1-033a-4851-be32-462fd29d67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e99e9a1-033a-4851-be32-462fd29d67d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93b1cb3-5174-49ba-a4e7-bfd9604cdb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Volume 9f8cff00-8fce-43e0-bd99-1f14e1d46b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17', 'volume_size': 1} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569701718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8cff00-8fce-43e0-bd99-1f14e1d46b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:21Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Creating volume 9f8cff00-8fce-43e0-bd99-1f14e1d46b17 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:21 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:21 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 1073741824 Sep 23 00:21:21 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:21 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 1073741824" returned: 0 in 0.745s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:22 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 Sep 23 00:21:22 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:22 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" returned: 0 in 0.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93b1cb3-5174-49ba-a4e7-bfd9604cdb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de247819-2e19-4994-9d3c-e407d53953a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Volume volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 (9f8cff00-8fce-43e0-bd99-1f14e1d46b17): created successfully Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de247819-2e19-4994-9d3c-e407d53953a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (6bc8b94a-4076-405a-beea-5957002f8647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d8d38d07-cfeb-4960-a7a4-92950bc19628 tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (fd02c8e3-3c5e-487a-84a3-c250fac1d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93530eb-a5af-43d6-a668-c6d0000675a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93530eb-a5af-43d6-a668-c6d0000675a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183935624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54c862d-3cae-40a6-bf2d-01dc67ac5af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:23Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa12e3f9-0cfe-4026-a118-3db443d46eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa12e3f9-0cfe-4026-a118-3db443d46eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951a9cb0-ac92-4c0d-97ed-a0651557efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951a9cb0-ac92-4c0d-97ed-a0651557efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54c862d-3cae-40a6-bf2d-01dc67ac5af0', 'volume_name': 'volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269edeec-0588-472c-9b1d-eb6024b49fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269edeec-0588-472c-9b1d-eb6024b49fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e4091-d825-42a5-8b5b-2743c15d3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Volume e54c862d-3cae-40a6-bf2d-01dc67ac5af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0', 'volume_size': 1} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-183935624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54c862d-3cae-40a6-bf2d-01dc67ac5af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972eb1a6175045d0850b2e52cece69ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:23Z,use_quota=True,user_id='3dedc4026a6543b6976fd311475168f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Creating volume e54c862d-3cae-40a6-bf2d-01dc67ac5af0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:23 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 1073741824 Sep 23 00:21:23 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-9f8cff00-8fce-43e0-bd99-1f14e1d46b17-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "cinder-9f8cff00-8fce-43e0-bd99-1f14e1d46b17-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Acquiring lock "cinder-quobyte-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad806890-3268-4f28-b02f-519ff10791d5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:23 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 Sep 23 00:21:23 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:24 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 1073741824" returned: 0 in 0.770s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:24 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 Sep 23 00:21:24 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:24 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:24 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17 Sep 23 00:21:24 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:24 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e4091-d825-42a5-8b5b-2743c15d3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b172d3d7-179a-46d9-82cd-f9a4e198bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Volume volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 (e54c862d-3cae-40a6-bf2d-01dc67ac5af0): created successfully Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b172d3d7-179a-46d9-82cd-f9a4e198bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Flow 'volume_create_manager' (fd02c8e3-3c5e-487a-84a3-c250fac1d01e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2c899ee1-111c-457e-b994-53858a1f0a10 tempest-AttachVolumeTestJSON-20470943 None] Created volume successfully. Sep 23 00:21:24 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "cinder-quobyte-9f8cff00-8fce-43e0-bd99-1f14e1d46b17" released by "delete_volume" :: held 0.918s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Created reservations ['5f6c2b62-9e63-4280-a3b8-c0a85bb11fa3', 'dd25fa55-ec12-41c1-8cb9-77078c268f18', '96c265b6-7678-41da-82b5-8fe1bd436978', '11157065-03cc-4cb9-acc7-75dfcbe257b8', '1ed316db-31d3-43a9-95d5-0a89c62b6e30'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:24 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:24 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:24 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Deleted volume successfully. Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7a21739-6587-43f8-a854-47ebe52b7493 tempest-VolumesActionsTest-845761425 None] Lock "cinder-9f8cff00-8fce-43e0-bd99-1f14e1d46b17-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (2e674076-6b4c-4d69-8371-6ba7eaad0a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95350f21-c99e-4c82-9aa3-a43470fa8c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95350f21-c99e-4c82-9aa3-a43470fa8c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079882818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce15a88-9c23-4d01-8059-4e2a715a6fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:26Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af795e-476c-4363-bb61-53ff2cfd83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af795e-476c-4363-bb61-53ff2cfd83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55ceb75-3300-4b1c-a9c9-9ac7618599d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55ceb75-3300-4b1c-a9c9-9ac7618599d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce15a88-9c23-4d01-8059-4e2a715a6fde', 'volume_name': 'volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b889894-a287-4690-8714-73117a1edb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b889894-a287-4690-8714-73117a1edb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c70261f-88e5-44f9-a01d-62f0022d5e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Volume 2ce15a88-9c23-4d01-8059-4e2a715a6fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde', 'volume_size': 1} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079882818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ce15a88-9c23-4d01-8059-4e2a715a6fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e857a6f57e545cea57876e738747945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:26Z,use_quota=True,user_id='bc88c36a40fb477da6bb82417c2ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Creating volume 2ce15a88-9c23-4d01-8059-4e2a715a6fde {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:25 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:21:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde 1073741824 Sep 23 00:21:25 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:26 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde 1073741824" returned: 0 in 0.841s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-df04afa5-77b5-410e-9008-9352282749c8 req-b3c14e41-deb5-46e3-825c-44070bf1f9be tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:26 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde Sep 23 00:21:26 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:27 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-df04afa5-77b5-410e-9008-9352282749c8 req-b3c14e41-deb5-46e3-825c-44070bf1f9be tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.437s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c70261f-88e5-44f9-a01d-62f0022d5e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52282c-80d5-49d3-86fd-82d0d2871317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-df04afa5-77b5-410e-9008-9352282749c8 req-b3c14e41-deb5-46e3-825c-44070bf1f9be tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Volume volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde (2ce15a88-9c23-4d01-8059-4e2a715a6fde): created successfully Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52282c-80d5-49d3-86fd-82d0d2871317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Flow 'volume_create_manager' (2e674076-6b4c-4d69-8371-6ba7eaad0a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b3911643-8039-44e6-abc3-c876382727e6 tempest-VolumesActionsTest-1747221907 None] Created volume successfully. Sep 23 00:21:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-df04afa5-77b5-410e-9008-9352282749c8 req-b3c14e41-deb5-46e3-825c-44070bf1f9be tempest-AttachVolumeTestJSON-20470943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbb12761-d242-411e-a1aa-ac4b5e2ff3df', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-df04afa5-77b5-410e-9008-9352282749c8 req-b3c14e41-deb5-46e3-825c-44070bf1f9be tempest-AttachVolumeTestJSON-20470943 None] attachment_update completed successfully. Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-2ce15a88-9c23-4d01-8059-4e2a715a6fde-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-2ce15a88-9c23-4d01-8059-4e2a715a6fde-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "cinder-quobyte-2ce15a88-9c23-4d01-8059-4e2a715a6fde" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-quobyte-2ce15a88-9c23-4d01-8059-4e2a715a6fde" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee0c85-2578-47aa-af18-719797e76491]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde Sep 23 00:21:29 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde" returned: 0 in 0.556s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde Sep 23 00:21:29 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:30 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ce15a88-9c23-4d01-8059-4e2a715a6fde" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-quobyte-2ce15a88-9c23-4d01-8059-4e2a715a6fde" released by "delete_volume" :: held 1.028s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-dd7bd900-3999-4d56-9737-e7294a4cb813 req-db0f34e9-0541-43d7-859e-f380f3965f2d tempest-AttachVolumeTestJSON-20470943 None] Terminate volume connection completed successfully. Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-dd7bd900-3999-4d56-9737-e7294a4cb813 req-db0f34e9-0541-43d7-859e-f380f3965f2d tempest-AttachVolumeTestJSON-20470943 None] Deleting attachment 975d8f57-a960-401a-9d6e-0d82c7231477. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Created reservations ['99c98a76-e93b-4b2f-94d7-b1d9dfee6844', 'd2fd57a2-7e7e-4525-8904-f002d9d3176f', 'bdb99400-ace2-4d28-9fae-4078e30cb742', '81fb38c3-0792-478e-bce9-fab5cf7ce719', '9b95082c-c7cb-4e00-a9ac-4a492b1c8f28'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:30 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:30 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:30 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Deleted volume successfully. Sep 23 00:21:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bcf60680-bd66-41fa-80f7-9c070f696f27 tempest-VolumesActionsTest-1747221907 None] Lock "cinder-2ce15a88-9c23-4d01-8059-4e2a715a6fde-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-0f231ce4-b6c2-4c3b-b0ec-b09bfa86dd70 req-6556d6e2-38cf-4d60-bcf5-56654e9246e3 tempest-AttachVolumeTestJSON-20470943 None] Terminate volume connection completed successfully. Sep 23 00:21:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-0f231ce4-b6c2-4c3b-b0ec-b09bfa86dd70 req-6556d6e2-38cf-4d60-bcf5-56654e9246e3 tempest-AttachVolumeTestJSON-20470943 None] Deleting attachment fbb12761-d242-411e-a1aa-ac4b5e2ff3df. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:37 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:37 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:37 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:41 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=107,cinder:UPDATE=113,cinder:DELETE=9,cinder:INSERT=27 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:41 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=120,cinder:UPDATE=122,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-e54c862d-3cae-40a6-bf2d-01dc67ac5af0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-e54c862d-3cae-40a6-bf2d-01dc67ac5af0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-quobyte-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" acquired by "delete_volume" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10e003-03c3-4963-960a-bf463855bb38]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 Sep 23 00:21:42 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0 Sep 23 00:21:42 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:43 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-e54c862d-3cae-40a6-bf2d-01dc67ac5af0" released by "delete_volume" :: held 0.981s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Created reservations ['2efea736-fab8-4d8c-bef5-b0fbb3d6252c', 'cfb28d58-794b-488c-adc3-9c03e51a32ce', '6e99fa90-ecf1-4b1d-b497-63ee4783e640', 'cb799fb0-932a-4b29-9fa1-d157a59cb862', '0f8a65de-0ab3-4366-9e9b-3be2ec295b6a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:43 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:43 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:44 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Deleted volume successfully. Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7def42f-1828-4181-8202-7776be9cb23e tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-e54c862d-3cae-40a6-bf2d-01dc67ac5af0-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-6559dd13-418b-47d6-8bd7-ba27539c9094-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-6559dd13-418b-47d6-8bd7-ba27539c9094-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-quobyte-6559dd13-418b-47d6-8bd7-ba27539c9094" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-6559dd13-418b-47d6-8bd7-ba27539c9094" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a02af7-27ed-459d-a2f8-d8ab7a4fade1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 Sep 23 00:21:45 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094" returned: 0 in 0.594s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094 Sep 23 00:21:45 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6559dd13-418b-47d6-8bd7-ba27539c9094" returned: 0 in 0.349s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-6559dd13-418b-47d6-8bd7-ba27539c9094" released by "delete_volume" :: held 1.063s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Created reservations ['2e464ce5-b5a6-4cd5-9967-4f3789d64006', 'e84f158c-8e9e-4852-ab4b-65663f22e797', '6528b4d3-5339-4796-82c5-97ab26e4fbb5', 'b40e0924-fab5-4535-bd6e-d0d99f49ada2', '61462b54-a739-4845-a910-928a8fe8fa4d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:46 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:46 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.297s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Deleted volume successfully. Sep 23 00:21:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cb5d1057-bc52-451c-8068-c267e936ed50 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-6559dd13-418b-47d6-8bd7-ba27539c9094-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-f7854842-1337-46c1-b316-0997d49e8def-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-f7854842-1337-46c1-b316-0997d49e8def-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "cinder-quobyte-f7854842-1337-46c1-b316-0997d49e8def" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-f7854842-1337-46c1-b316-0997d49e8def" acquired by "delete_volume" :: waited 0.050s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2e1eb-5a4d-44d5-a405-2ff3de28c979]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:47 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def Sep 23 00:21:47 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:48 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:48 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def Sep 23 00:21:48 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:48 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f7854842-1337-46c1-b316-0997d49e8def" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-quobyte-f7854842-1337-46c1-b316-0997d49e8def" released by "delete_volume" :: held 1.188s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Created reservations ['6f2d7397-94e3-4921-b57f-515af7ae5eb0', 'da2f2ac8-8bcf-4393-852b-691ecddc9958', '868d8ed4-0c8a-45c0-a7fe-65b03bc58f30', '36ce2ebd-59e2-40d9-8110-41e4b71d3e8b', '80e06ea3-e927-43b5-9048-9cc16c0a3b7b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:49 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:21:49 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:49 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.563s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Deleted volume successfully. Sep 23 00:21:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-24a29bdb-baf1-4943-8bfd-3c5249d2ba99 tempest-AttachVolumeTestJSON-20470943 None] Lock "cinder-f7854842-1337-46c1-b316-0997d49e8def-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:59 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=22 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:59 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=32,cinder:SELECT=14,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (7cf57c7f-885c-469e-8236-08739222c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bd1ed8-1e0c-4ff0-8346-d77b9cc2fe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bd1ed8-1e0c-4ff0-8346-d77b9cc2fe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1410151080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daef7ef-62f1-4a41-98f5-34857ac3f26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384fe5c5-b4a2-4c42-b8cf-128bcc764ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384fe5c5-b4a2-4c42-b8cf-128bcc764ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5333dc-e125-44f1-808f-04115d3db1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5333dc-e125-44f1-808f-04115d3db1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2daef7ef-62f1-4a41-98f5-34857ac3f26a', 'volume_name': 'volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6361c7ac-1399-4742-96ea-a0172be4d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6361c7ac-1399-4742-96ea-a0172be4d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f5e74-b5cf-4c69-a647-2f4d289ca0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Volume 2daef7ef-62f1-4a41-98f5-34857ac3f26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a', 'volume_size': 1} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1410151080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daef7ef-62f1-4a41-98f5-34857ac3f26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Creating volume 2daef7ef-62f1-4a41-98f5-34857ac3f26a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:04 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a 1073741824 Sep 23 00:22:04 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Flow 'volume_create_manager' (e8aa726d-f348-4a15-ae1f-2fbfca811159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd47949-aa37-4baf-9817-0e83a525fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd47949-aa37-4baf-9817-0e83a525fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-471898922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768fd063-e5f4-47dd-a0da-5d73c9aa66c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fc2ebe1c21433a9b8e49dde8779ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='d4277b8b606a448bae39dd5a388a3f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d5b29-7d05-47f4-aae2-8e6e4aa112b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d5b29-7d05-47f4-aae2-8e6e4aa112b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aec0659-b7a9-4252-85ae-ecddfdb57d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aec0659-b7a9-4252-85ae-ecddfdb57d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768fd063-e5f4-47dd-a0da-5d73c9aa66c1', 'volume_name': 'volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee593318-d343-42bc-8156-9857c45183a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee593318-d343-42bc-8156-9857c45183a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8757e272-a3cd-487c-bc4e-8b6b827c2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Volume 768fd063-e5f4-47dd-a0da-5d73c9aa66c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1', 'volume_size': 1} Sep 23 00:22:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:05 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a 1073741824" returned: 0 in 0.649s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a Sep 23 00:22:05 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.973s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-471898922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768fd063-e5f4-47dd-a0da-5d73c9aa66c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fc2ebe1c21433a9b8e49dde8779ee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:04Z,use_quota=True,user_id='d4277b8b606a448bae39dd5a388a3f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Creating volume 768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 1073741824 Sep 23 00:22:05 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f5e74-b5cf-4c69-a647-2f4d289ca0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ece2939-3380-4b57-ba5f-df39974babb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Volume volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a (2daef7ef-62f1-4a41-98f5-34857ac3f26a): created successfully Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ece2939-3380-4b57-ba5f-df39974babb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (7cf57c7f-885c-469e-8236-08739222c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-204b58a9-bdbe-4bd0-97af-4531c05306fd tempest-VolumesListAdminTestJSON-103194435 None] Created volume successfully. Sep 23 00:22:06 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 1073741824" returned: 0 in 0.658s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:06 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 Sep 23 00:22:06 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Acquiring lock "cinder-dbf1ed20-e675-4deb-9260-7a9d50020fd6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "cinder-dbf1ed20-e675-4deb-9260-7a9d50020fd6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Acquiring lock "cinder-quobyte-dbf1ed20-e675-4deb-9260-7a9d50020fd6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "cinder-quobyte-dbf1ed20-e675-4deb-9260-7a9d50020fd6" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:07 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8757e272-a3cd-487c-bc4e-8b6b827c2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbde889c-4b24-4e6c-b142-79d898db6400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544163c-f52f-4e2f-8481-3cbb4d566a14]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Volume volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 (768fd063-e5f4-47dd-a0da-5d73c9aa66c1): created successfully Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbde889c-4b24-4e6c-b142-79d898db6400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Flow 'volume_create_manager' (e8aa726d-f348-4a15-ae1f-2fbfca811159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-2902171b-b566-4c51-bd5b-732fffd06f46 req-25fdfc3c-08af-4c1b-aa90-6bf0261ff12c tempest-VolumesSnapshotsTestJSON-561831325 None] Created volume successfully. Sep 23 00:22:07 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 Sep 23 00:22:07 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (9ae425e9-6e81-43f5-8492-82b49822eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987cf61-7d9f-4a77-9e2e-940f5fe4ba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987cf61-7d9f-4a77-9e2e-940f5fe4ba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-381667740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2686de2-2a7b-41cb-8b12-155ccefe1d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:07Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d656c9-a252-4e12-be16-73c1690a6d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d656c9-a252-4e12-be16-73c1690a6d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b05d8-0aec-4607-b99a-96a0dbc2d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b05d8-0aec-4607-b99a-96a0dbc2d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2686de2-2a7b-41cb-8b12-155ccefe1d0c', 'volume_name': 'volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e47346-ed05-4ac5-b200-510b782dc319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e47346-ed05-4ac5-b200-510b782dc319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a7be0-bd33-4249-9537-b14373f3dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Volume d2686de2-2a7b-41cb-8b12-155ccefe1d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c', 'volume_size': 1} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-381667740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2686de2-2a7b-41cb-8b12-155ccefe1d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:07Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Creating volume d2686de2-2a7b-41cb-8b12-155ccefe1d0c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c 1073741824 Sep 23 00:22:07 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:07 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6" returned: 0 in 0.613s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6 Sep 23 00:22:07 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c 1073741824" returned: 0 in 0.687s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dbf1ed20-e675-4deb-9260-7a9d50020fd6" returned: 0 in 0.478s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c Sep 23 00:22:08 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "cinder-quobyte-dbf1ed20-e675-4deb-9260-7a9d50020fd6" released by "delete_volume" :: held 1.206s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Created reservations ['4d4e9d0d-94c7-4592-a5a4-9491f6726612', 'a649b8d6-f3a8-4030-af4a-9711d997e595', '02a4dde7-4341-43f8-8c4e-519653d75bd1', 'fa58c471-e7f1-4978-a9db-c741095a60d3', 'd45bf007-c032-4d84-a039-de94daf077fa'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:08 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" returned: 0 in 0.534s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.266s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Creating offline snapshot e4209e1a-3240-4f23-8594-50aaac7ade94 of volume 768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a7be0-bd33-4249-9537-b14373f3dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3c5f30-eea3-41c3-9945-c4cdb04cade7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77d8c5-c2b6-427b-96ad-12ca544a9430]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Volume volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c (d2686de2-2a7b-41cb-8b12-155ccefe1d0c): created successfully Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3c5f30-eea3-41c3-9945-c4cdb04cade7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (9ae425e9-6e81-43f5-8492-82b49822eeae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1a12a2f3-6b82-4a93-9b23-a97debba14ba tempest-VolumesListAdminTestJSON-103194435 None] Created volume successfully. Sep 23 00:22:08 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 Sep 23 00:22:08 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Deleted volume successfully. Sep 23 00:22:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-34c603ac-3852-438a-85a6-732b7b406419 tempest-AttachVolumeShelveTestJSON-102712789 None] Lock "cinder-dbf1ed20-e675-4deb-9260-7a9d50020fd6-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:09 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 1G Sep 23 00:22:09 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 1G" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 Sep 23 00:22:10 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (4d1bd0c4-e339-450d-8bcc-13b136b97516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ebaec-0369-45d8-a781-a0678d067ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94" returned: 0 in 0.590s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 is being set with open permissions: ugo+rw Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ebaec-0369-45d8-a781-a0678d067ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-616954810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c96f572-52c4-43eb-ba1e-d91089418917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:11Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdab848-0806-4298-a10b-2a4d87d642d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 Sep 23 00:22:10 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdab848-0806-4298-a10b-2a4d87d642d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263339f0-2339-4ee7-a94d-4ce213e12924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263339f0-2339-4ee7-a94d-4ce213e12924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c96f572-52c4-43eb-ba1e-d91089418917', 'volume_name': 'volume-0c96f572-52c4-43eb-ba1e-d91089418917', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1195562d-7235-41d7-b874-92b18e84c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1195562d-7235-41d7-b874-92b18e84c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa10b0f-2adc-443d-9ee9-6d02b8dba73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Volume 0c96f572-52c4-43eb-ba1e-d91089418917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c96f572-52c4-43eb-ba1e-d91089418917', 'volume_size': 1} Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:10 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94" returned: 0 in 0.335s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info Sep 23 00:22:11 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info is being set with open permissions: ugo+rw Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info Sep 23 00:22:11 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.info" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.169s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-616954810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c96f572-52c4-43eb-ba1e-d91089418917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9470509401164d958a836313d819904c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:11Z,use_quota=True,user_id='6a3f96759b414370bda6846200b7c1a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Creating volume 0c96f572-52c4-43eb-ba1e-d91089418917 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d5dfa74c-d39b-44a7-bec8-28bb2afdd268 req-152244ef-f1f2-49ab-8acd-2d2476543087 tempest-VolumesSnapshotsTestJSON-561831325 None] Create snapshot completed successfully Sep 23 00:22:11 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 1073741824 Sep 23 00:22:11 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "cinder-e4209e1a-3240-4f23-8594-50aaac7ade94-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-e4209e1a-3240-4f23-8594-50aaac7ade94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "cinder-quobyte-e4209e1a-3240-4f23-8594-50aaac7ade94" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-e4209e1a-3240-4f23-8594-50aaac7ade94" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Deleting offline snapshot e4209e1a-3240-4f23-8594-50aaac7ade94 of volume 768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] snapshot_file for this snap is: volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33aece-bf90-45b8-84e2-04f95d60626e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:12 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 Sep 23 00:22:12 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 1073741824" returned: 0 in 0.819s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:12 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 Sep 23 00:22:12 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94" returned: 0 in 0.767s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:13 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411c32c-365b-472d-86a8-8f16120cbf93]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa10b0f-2adc-443d-9ee9-6d02b8dba73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c96f572-52c4-43eb-ba1e-d91089418917', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a3b6a-f773-40e9-84fc-dda6093bfd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Volume volume-0c96f572-52c4-43eb-ba1e-d91089418917 (0c96f572-52c4-43eb-ba1e-d91089418917): created successfully Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034a3b6a-f773-40e9-84fc-dda6093bfd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Flow 'volume_create_manager' (4d1bd0c4-e339-450d-8bcc-13b136b97516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-db86a465-681c-412b-a498-fa875f978e4d tempest-VolumesListAdminTestJSON-103194435 None] Created volume successfully. Sep 23 00:22:13 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 Sep 23 00:22:13 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:13 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" returned: 0 in 0.710s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 Sep 23 00:22:13 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94" returned: 0 in 0.740s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94 Sep 23 00:22:14 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1.e4209e1a-3240-4f23-8594-50aaac7ade94" returned: 0 in 0.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-e4209e1a-3240-4f23-8594-50aaac7ade94" released by "_delete_snapshot" :: held 3.027s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" released by "delete_snapshot" :: held 3.089s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.quota [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Created reservations ['3e20e3a5-d46f-4f13-a3c8-b0cb83ac8e55', '03374bdb-fd7b-4f25-9e84-5775183fdcc5', 'e758e9c3-707e-49ea-b8e5-150bfd26fe67', '9b5a247b-00e1-4b45-97b5-fb2cb0666ad1', 'a80819c4-ee66-49aa-a21e-e2288cf46cc3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Delete snapshot completed successfully. Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c6db8b2c-9e51-4e6a-bbdf-69acf9ab9944 req-74819d04-da9a-4224-8e31-d6fd8be6d75b tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-e4209e1a-3240-4f23-8594-50aaac7ade94-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Flow 'volume_create_manager' (0a753b06-a54e-4df0-a1e3-dc28808881f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b622a-bfa7-434c-8bad-8911204cd004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3b622a-bfa7-434c-8bad-8911204cd004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6785914c-272c-4217-8896-faf47ea6ca8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='269d32e245ce42cbb84dc977563774bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:16Z,use_quota=True,user_id='3976c77c33af4361b5821eadeb28b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7a5b2-3e09-476f-bd4b-4a5fcb9e4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de7a5b2-3e09-476f-bd4b-4a5fcb9e4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ae4ec9-21ba-4c0b-94ae-8d60bca2935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ae4ec9-21ba-4c0b-94ae-8d60bca2935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6785914c-272c-4217-8896-faf47ea6ca8a', 'volume_name': 'volume-6785914c-272c-4217-8896-faf47ea6ca8a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5db820-0267-4af8-a57c-f9526822b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5db820-0267-4af8-a57c-f9526822b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb597556-67b0-4279-9f18-b4b4019f1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Volume 6785914c-272c-4217-8896-faf47ea6ca8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6785914c-272c-4217-8896-faf47ea6ca8a', 'volume_size': 1} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6785914c-272c-4217-8896-faf47ea6ca8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='269d32e245ce42cbb84dc977563774bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:16Z,use_quota=True,user_id='3976c77c33af4361b5821eadeb28b0ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Creating volume 6785914c-272c-4217-8896-faf47ea6ca8a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:15 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a 1073741824 Sep 23 00:22:15 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "cinder-768fd063-e5f4-47dd-a0da-5d73c9aa66c1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-768fd063-e5f4-47dd-a0da-5d73c9aa66c1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcbb46d-f5dc-4f76-9c86-9f7c681a784e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 Sep 23 00:22:16 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a 1073741824" returned: 0 in 0.892s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" returned: 0 in 0.591s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1 Sep 23 00:22:16 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a Sep 23 00:22:16 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:17 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb597556-67b0-4279-9f18-b4b4019f1e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6785914c-272c-4217-8896-faf47ea6ca8a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0cad4-0d78-4260-a3f1-6748627b30c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Volume volume-6785914c-272c-4217-8896-faf47ea6ca8a (6785914c-272c-4217-8896-faf47ea6ca8a): created successfully Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b0cad4-0d78-4260-a3f1-6748627b30c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Flow 'volume_create_manager' (0a753b06-a54e-4df0-a1e3-dc28808881f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-quobyte-768fd063-e5f4-47dd-a0da-5d73c9aa66c1" released by "delete_volume" :: held 1.192s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e3ea6777-b02d-40fa-bc80-d5d614382cd4 tempest-VolumesListAdminTestJSON-1191316192 None] Created volume successfully. Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.quota [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Created reservations ['1f0ce3fb-71b7-4abc-a6b2-304031c72efb', '3e68f957-f623-4c90-ab35-8c7faa5c4a4a', '3d64324b-e93d-43e8-b3fe-a927fd7219ba', '43c9e1fa-a301-4084-b829-3195b190dcf1', 'd2bd8bdf-872f-4711-84fb-5da1263f18eb'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:17 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:17 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Acquiring lock "cinder-6785914c-272c-4217-8896-faf47ea6ca8a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "cinder-6785914c-272c-4217-8896-faf47ea6ca8a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.477s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.manager [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Acquiring lock "cinder-quobyte-6785914c-272c-4217-8896-faf47ea6ca8a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Deleted volume successfully. Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-0c96f572-52c4-43eb-ba1e-d91089418917-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-686dc082-0d4e-400a-92f7-750d177de967 req-336e6fb3-d842-4cb3-98ad-c5afb0b6c3ac tempest-VolumesSnapshotsTestJSON-561831325 None] Lock "cinder-768fd063-e5f4-47dd-a0da-5d73c9aa66c1-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "cinder-quobyte-6785914c-272c-4217-8896-faf47ea6ca8a" acquired by "delete_volume" :: waited 0.114s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-0c96f572-52c4-43eb-ba1e-d91089418917-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c82a33-21c4-4eaa-9fb4-bf60ccca2ee3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-quobyte-0c96f572-52c4-43eb-ba1e-d91089418917" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-0c96f572-52c4-43eb-ba1e-d91089418917" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf49fc-a525-4020-a378-81d1850dc8fb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a Sep 23 00:22:18 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 Sep 23 00:22:18 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a" returned: 0 in 0.786s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a Sep 23 00:22:19 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917" returned: 0 in 0.913s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917 Sep 23 00:22:19 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6785914c-272c-4217-8896-faf47ea6ca8a" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "cinder-quobyte-6785914c-272c-4217-8896-faf47ea6ca8a" released by "delete_volume" :: held 1.431s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Created reservations ['d2f022cd-656a-4e3a-94db-7258b64b7c81', '21e70f5f-2028-444f-8178-5fa21d157a56', 'b6795a42-2d29-42b4-bd34-585ae4486de6', '0c93800f-6a3b-4f9b-9422-19b091a430f6', '9bee12d3-eb06-4219-befa-b127adea1d24'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:20 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0c96f572-52c4-43eb-ba1e-d91089418917" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-0c96f572-52c4-43eb-ba1e-d91089418917" released by "delete_volume" :: held 1.505s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Created reservations ['31ffc589-d2de-4e91-94be-a94f08cf9fcf', 'b28db9f1-37bf-47fa-8d57-df7d7a9b0727', '0258f2ae-78fa-4ee9-936b-aea0518e6c59', 'bbb25b1b-bf96-48dd-8d22-6e082368db9d', '12847b0a-de72-47cf-8b9e-918e74ce0382'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:20 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Deleted volume successfully. Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1cf716cb-af16-47cd-8275-ee54faa96a62 tempest-VolumesListAdminTestJSON-1191316192 None] Lock "cinder-6785914c-272c-4217-8896-faf47ea6ca8a-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-d2686de2-2a7b-41cb-8b12-155ccefe1d0c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-d2686de2-2a7b-41cb-8b12-155ccefe1d0c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.749s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Deleted volume successfully. Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-quobyte-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8680d3d-4528-4fe4-b2fe-86c33a12b11d tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-0c96f572-52c4-43eb-ba1e-d91089418917-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8201701e-14e8-4c60-bcf3-57fc63f6597a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c Sep 23 00:22:21 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:21 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" returned: 0 in 0.679s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c Sep 23 00:22:21 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" returned: 0 in 0.455s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-d2686de2-2a7b-41cb-8b12-155ccefe1d0c" released by "delete_volume" :: held 1.217s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Created reservations ['0f4eabf0-69d2-4b9c-a7bd-0a79fc2c8164', 'f364c9fa-86a9-45d0-b68a-29cca23d0c22', 'f6d0600a-4441-45d3-8064-583bb601765e', 'b6d0f3da-20a1-4b86-b25d-7713c366c66d', '123d584e-b04c-4345-8c81-293d3340cfbe'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:22 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Deleted volume successfully. Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0776469-ee9f-4fa7-a1cf-ad12c9de46d4 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-d2686de2-2a7b-41cb-8b12-155ccefe1d0c-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-2daef7ef-62f1-4a41-98f5-34857ac3f26a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-2daef7ef-62f1-4a41-98f5-34857ac3f26a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "cinder-quobyte-2daef7ef-62f1-4a41-98f5-34857ac3f26a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-2daef7ef-62f1-4a41-98f5-34857ac3f26a" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2e901-f84c-4e2f-9065-11b8fe9ec733]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:23 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a Sep 23 00:22:23 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:24 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a" returned: 0 in 0.600s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:24 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a Sep 23 00:22:24 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:24 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2daef7ef-62f1-4a41-98f5-34857ac3f26a" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-quobyte-2daef7ef-62f1-4a41-98f5-34857ac3f26a" released by "delete_volume" :: held 1.216s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Created reservations ['81e49faa-746a-4c83-b61f-fd2bfb85f03f', 'dfb3f860-fad7-41e2-abd7-593e2041024a', 'b039a9e3-50d2-47b5-bf75-632ba256d296', '27561127-13e7-4aa5-b440-d57217e5ccce', '4380f42d-8208-4192-b232-bee33616e574'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:25 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:25 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:25 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Deleted volume successfully. Sep 23 00:22:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-538af2c3-c902-4026-8238-e92501864b94 tempest-VolumesListAdminTestJSON-103194435 None] Lock "cinder-2daef7ef-62f1-4a41-98f5-34857ac3f26a-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (48ef7b61-0fda-4d66-9354-458c6c9c8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711200e-76fc-46f3-a2f8-3c4b0a8daa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a711200e-76fc-46f3-a2f8-3c4b0a8daa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1578017458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:27Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabefbf8-a910-4e30-ab56-b9b464008a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabefbf8-a910-4e30-ab56-b9b464008a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df73ffb-5f24-49da-ad49-0d92eba90d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df73ffb-5f24-49da-ad49-0d92eba90d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee', 'volume_name': 'volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61501b3-bead-4e96-917c-133ce81119cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61501b3-bead-4e96-917c-133ce81119cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ed14b9-9b40-42bc-9c9a-fb4fcf39ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Volume a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee', 'volume_size': 1} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1578017458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:27Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Creating volume a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:27 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee 1073741824 Sep 23 00:22:27 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee 1073741824" returned: 0 in 0.922s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:28 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee Sep 23 00:22:28 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ed14b9-9b40-42bc-9c9a-fb4fcf39ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6f8948-ffdd-4ed3-afbb-e69ea8110667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Volume volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee (a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee): created successfully Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6f8948-ffdd-4ed3-afbb-e69ea8110667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (48ef7b61-0fda-4d66-9354-458c6c9c8874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-32a4b527-c3ad-4a0d-9d5c-4fc996db12e4 tempest-VolumesTestJSON-1605800721 None] Created volume successfully. Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (57154385-c430-4548-8252-fac407db31b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba836a6d-e1d2-43a0-996a-9a5042a58b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba836a6d-e1d2-43a0-996a-9a5042a58b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-107369245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71cd8f4-9c64-42ee-8c24-51b767265398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:31Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3781b53d-a213-4f68-97c9-989a10566585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3781b53d-a213-4f68-97c9-989a10566585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7e4ec-0bd2-4ca4-b361-84ab102f949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7e4ec-0bd2-4ca4-b361-84ab102f949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71cd8f4-9c64-42ee-8c24-51b767265398', 'volume_name': 'volume-e71cd8f4-9c64-42ee-8c24-51b767265398', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89d9f4f-a6ad-4d84-94c8-0c00a36ebddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89d9f4f-a6ad-4d84-94c8-0c00a36ebddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f20001d-f541-4176-a99c-c6ecf514c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Volume e71cd8f4-9c64-42ee-8c24-51b767265398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71cd8f4-9c64-42ee-8c24-51b767265398', 'volume_size': 1} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-107369245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71cd8f4-9c64-42ee-8c24-51b767265398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:31Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Creating volume e71cd8f4-9c64-42ee-8c24-51b767265398 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:30 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 1073741824 Sep 23 00:22:30 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:31 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 1073741824" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:31 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 Sep 23 00:22:31 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:32 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f20001d-f541-4176-a99c-c6ecf514c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71cd8f4-9c64-42ee-8c24-51b767265398', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55894520-a4ab-4a94-aa5e-913357ad569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Volume volume-e71cd8f4-9c64-42ee-8c24-51b767265398 (e71cd8f4-9c64-42ee-8c24-51b767265398): created successfully Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55894520-a4ab-4a94-aa5e-913357ad569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (57154385-c430-4548-8252-fac407db31b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ac5fbda0-97b7-44bb-ab7c-509e3d26c1dc tempest-VolumesTestJSON-1605800721 None] Created volume successfully. Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (d9a8fe99-7ea4-4945-982b-4794209d85f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368988ca-9ef3-4bb7-9fc7-8d2fdb3177c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368988ca-9ef3-4bb7-9fc7-8d2fdb3177c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1068742101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fba59a-af33-42a3-96df-adc91fae30fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:34Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bff296-e526-4494-8ff1-e0af5482f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bff296-e526-4494-8ff1-e0af5482f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241dbc0-2643-480c-b185-8136da5d98c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241dbc0-2643-480c-b185-8136da5d98c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74fba59a-af33-42a3-96df-adc91fae30fd', 'volume_name': 'volume-74fba59a-af33-42a3-96df-adc91fae30fd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351df3e3-65a5-4d88-a66e-1f67bc87b694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351df3e3-65a5-4d88-a66e-1f67bc87b694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0af011-b804-451a-93d5-5eb39864c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Volume 74fba59a-af33-42a3-96df-adc91fae30fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74fba59a-af33-42a3-96df-adc91fae30fd', 'volume_size': 1} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1068742101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fba59a-af33-42a3-96df-adc91fae30fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd09c19fcba84cf48aea6afece7b27a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:34Z,use_quota=True,user_id='689876ba66a348deb4e1047d507a87a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Creating volume 74fba59a-af33-42a3-96df-adc91fae30fd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:33 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd 1073741824 Sep 23 00:22:33 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:34 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd 1073741824" returned: 0 in 0.722s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:34 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd Sep 23 00:22:34 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:35 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0af011-b804-451a-93d5-5eb39864c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fba59a-af33-42a3-96df-adc91fae30fd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0736b8d-8b68-4656-9b7b-9cc810cdba7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Volume volume-74fba59a-af33-42a3-96df-adc91fae30fd (74fba59a-af33-42a3-96df-adc91fae30fd): created successfully Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0736b8d-8b68-4656-9b7b-9cc810cdba7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Flow 'volume_create_manager' (d9a8fe99-7ea4-4945-982b-4794209d85f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd7fa9f6-075b-4367-bc02-7a0905b4e17f tempest-VolumesTestJSON-1605800721 None] Created volume successfully. Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:37 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:37 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:37 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-74fba59a-af33-42a3-96df-adc91fae30fd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-74fba59a-af33-42a3-96df-adc91fae30fd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-quobyte-74fba59a-af33-42a3-96df-adc91fae30fd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-74fba59a-af33-42a3-96df-adc91fae30fd" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d1e7a-1423-424f-9391-bc55cb3aa597]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd Sep 23 00:22:38 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:38 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd Sep 23 00:22:38 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:39 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74fba59a-af33-42a3-96df-adc91fae30fd" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-74fba59a-af33-42a3-96df-adc91fae30fd" released by "delete_volume" :: held 0.885s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Created reservations ['360f398c-dc9c-4002-ad05-eb21580291c2', '25afadeb-c318-4f38-8816-363013a83298', '10afb55a-2e52-4cd2-aaaa-01f03a60d13b', 'f24624ab-2da9-4d14-8540-682c789931ca', 'a656f1f9-c5db-453e-8bc1-843859b050d2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:39 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:39 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:39 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Deleted volume successfully. Sep 23 00:22:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1f336e51-a76c-4938-a208-ab37c5dfcfa4 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-74fba59a-af33-42a3-96df-adc91fae30fd-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-e71cd8f4-9c64-42ee-8c24-51b767265398-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "cinder-e71cd8f4-9c64-42ee-8c24-51b767265398-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-quobyte-e71cd8f4-9c64-42ee-8c24-51b767265398" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-e71cd8f4-9c64-42ee-8c24-51b767265398" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bff436-59e8-41a2-99ea-38725959ccee]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 Sep 23 00:22:40 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398" returned: 0 in 0.729s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398 Sep 23 00:22:41 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e71cd8f4-9c64-42ee-8c24-51b767265398" returned: 0 in 0.660s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-e71cd8f4-9c64-42ee-8c24-51b767265398" released by "delete_volume" :: held 1.455s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Created reservations ['57a93a7a-e68f-411c-86ed-216c3bf93d69', '497ca88a-c870-4bf3-a84c-ce44ba263cb4', 'cb0cbcc2-665f-4951-830f-bc7d3c54abd7', '38820272-3580-44e7-9b84-922904ddc67d', 'ff895f65-eef3-4854-962e-cdccf5426956'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:42 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:42 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Deleted volume successfully. Sep 23 00:22:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d58e487-04a6-4c86-b040-cb729699c6da tempest-VolumesTestJSON-1605800721 None] Lock "cinder-e71cd8f4-9c64-42ee-8c24-51b767265398-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "cinder-quobyte-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4438717e-c3c1-4a41-bbb6-f02e1d2e361f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee Sep 23 00:22:43 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:43 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" returned: 0 in 0.567s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee Sep 23 00:22:43 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-quobyte-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee" released by "delete_volume" :: held 1.125s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Created reservations ['e9e2bb7a-ed2b-4a4e-b75f-647e5ea94417', '6d4bc7ae-2b91-4eaf-bf67-da31d0135769', '17587d6b-0c41-47d4-954a-d5f1beddef17', '450d4eff-14aa-4905-83eb-609e1958240f', 'ba18bb7c-5461-4b0f-867f-684304b03236'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:22:44 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Deleted volume successfully. Sep 23 00:22:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2ca88685-7dfd-40df-a7c0-385d33d4b110 tempest-VolumesTestJSON-1605800721 None] Lock "cinder-a450bc3b-7b5c-47ef-b3ab-8ab61e3c64ee-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Flow 'volume_create_manager' (15950f2e-86e4-4c53-aa24-930272b0d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2276d235-aa6c-4ad2-9db2-ad2e7deaade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2276d235-aa6c-4ad2-9db2-ad2e7deaade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1202841945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881a56e-66e3-4b5b-940a-3d0a2d1c008d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb241598c8e24cf58c899185128b3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='dbf3dda0e0ba464c80772bf194dc6d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76acb18-cdd0-4e21-9aae-fdbc75aadced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b76acb18-cdd0-4e21-9aae-fdbc75aadced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effa0863-f9f4-415e-a872-7030f6d02a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effa0863-f9f4-415e-a872-7030f6d02a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3881a56e-66e3-4b5b-940a-3d0a2d1c008d', 'volume_name': 'volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677ec6d-e625-4fb1-a44d-a4f13f4f08a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2677ec6d-e625-4fb1-a44d-a4f13f4f08a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c948c89-ed03-4d2b-a347-aa87df3e67ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Volume 3881a56e-66e3-4b5b-940a-3d0a2d1c008d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d', 'volume_size': 1} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1202841945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3881a56e-66e3-4b5b-940a-3d0a2d1c008d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb241598c8e24cf58c899185128b3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:54Z,use_quota=True,user_id='dbf3dda0e0ba464c80772bf194dc6d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Creating volume 3881a56e-66e3-4b5b-940a-3d0a2d1c008d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:54 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d 1073741824 Sep 23 00:22:54 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:55 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d 1073741824" returned: 0 in 1.027s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:55 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d Sep 23 00:22:55 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:55 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" returned: 0 in 0.567s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c948c89-ed03-4d2b-a347-aa87df3e67ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90759432-9d72-4164-a2fc-f64d4f54b642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Volume volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d (3881a56e-66e3-4b5b-940a-3d0a2d1c008d): created successfully Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90759432-9d72-4164-a2fc-f64d4f54b642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Flow 'volume_create_manager' (15950f2e-86e4-4c53-aa24-930272b0d69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0c6ab00a-b5f4-4e9e-81fe-0f4cec19d3d6 tempest-TestMinimumBasicScenario-1852591426 None] Created volume successfully. Sep 23 00:22:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e49f71de-0474-4116-9a26-90e76e3973f6 tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-2109634896: creating Sep 23 00:22:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e49f71de-0474-4116-9a26-90e76e3973f6 tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-2109634896: created successfully Sep 23 00:22:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e49f71de-0474-4116-9a26-90e76e3973f6 tempest-GroupSnapshotsTest-1853160388 None] Create group completed successfully. Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Flow 'volume_create_manager' (081c02fd-e649-4a0f-ad5c-a72a80f64d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d880986-814e-4013-af7d-de900254e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d880986-814e-4013-af7d-de900254e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145062291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66a2f84-c619-482f-9271-9f70e75b7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ab7ccd77cb45259b3db1d07fc1285f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:58Z,use_quota=True,user_id='622d300b062842ce86130fb4aa3bbbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd042a26-3568-4dac-87bf-36d2f2deeca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd042a26-3568-4dac-87bf-36d2f2deeca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa53fc34-c446-47f0-a7a1-6394d846c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa53fc34-c446-47f0-a7a1-6394d846c448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66a2f84-c619-482f-9271-9f70e75b7887', 'volume_name': 'volume-e66a2f84-c619-482f-9271-9f70e75b7887', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de8cd11-6632-4de8-8357-a1e4f5ff681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de8cd11-6632-4de8-8357-a1e4f5ff681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66695083-56cb-4b82-9b3c-638b986e11a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Volume e66a2f84-c619-482f-9271-9f70e75b7887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66a2f84-c619-482f-9271-9f70e75b7887', 'volume_size': 1} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1145062291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66a2f84-c619-482f-9271-9f70e75b7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6ab7ccd77cb45259b3db1d07fc1285f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:58Z,use_quota=True,user_id='622d300b062842ce86130fb4aa3bbbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Creating volume e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:57 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 1073741824 Sep 23 00:22:57 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (7744e43d-ef47-464f-97ec-4fefe6f5bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2896f9-e542-4729-9538-93d0a1fee3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6b0e1d01-575e-4931-806a-be8e17e1c14e req-c76c18af-c27a-4c42-96a6-93f941e0285c tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2896f9-e542-4729-9538-93d0a1fee3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150716780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bccaf136-a501-4584-88ac-487b279d7d11,host='devstack@QuobyteHD#QuobyteHD',id=fcfe8e8b-0b0f-4fed-b95c-f078af535c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:58Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba739cb8-6982-44c9-9dce-b7f98e4325a1),volume_type_id=ba739cb8-6982-44c9-9dce-b7f98e4325a1)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7dcc07-4e3f-4dd8-bc9c-004ecb8f0d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7dcc07-4e3f-4dd8-bc9c-004ecb8f0d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27104780-2085-4014-aae4-85ebd16b37e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27104780-2085-4014-aae4-85ebd16b37e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcfe8e8b-0b0f-4fed-b95c-f078af535c75', 'volume_name': 'volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696212ca-4bab-42d6-b8dc-36f1bc11deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696212ca-4bab-42d6-b8dc-36f1bc11deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f28d7-d41e-40e9-8f50-c598eb6c81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Volume fcfe8e8b-0b0f-4fed-b95c-f078af535c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75', 'volume_size': 1} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:58 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 1073741824" returned: 0 in 0.772s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:58 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:22:58 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:59 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6b0e1d01-575e-4931-806a-be8e17e1c14e req-c76c18af-c27a-4c42-96a6-93f941e0285c tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.498s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66695083-56cb-4b82-9b3c-638b986e11a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66a2f84-c619-482f-9271-9f70e75b7887', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf948a54-3f87-46b0-84e8-c2afca6440ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6b0e1d01-575e-4931-806a-be8e17e1c14e req-c76c18af-c27a-4c42-96a6-93f941e0285c tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.463s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bccaf136-a501-4584-88ac-487b279d7d11,created_at=2026-09-22T22:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-150716780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bccaf136-a501-4584-88ac-487b279d7d11,host='devstack@QuobyteHD#QuobyteHD',id=fcfe8e8b-0b0f-4fed-b95c-f078af535c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:58Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba739cb8-6982-44c9-9dce-b7f98e4325a1),volume_type_id=ba739cb8-6982-44c9-9dce-b7f98e4325a1)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Creating volume fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Volume volume-e66a2f84-c619-482f-9271-9f70e75b7887 (e66a2f84-c619-482f-9271-9f70e75b7887): created successfully Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf948a54-3f87-46b0-84e8-c2afca6440ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Flow 'volume_create_manager' (081c02fd-e649-4a0f-ad5c-a72a80f64d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:59 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 1073741824 Sep 23 00:22:59 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=118,cinder:SELECT=97,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-50fefcd8-14d9-4199-b511-eb64de180bdd tempest-VolumesActionsTest-1854459563 None] Created volume successfully. Sep 23 00:22:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-6b0e1d01-575e-4931-806a-be8e17e1c14e req-c76c18af-c27a-4c42-96a6-93f941e0285c tempest-TestMinimumBasicScenario-1852591426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '920cb6f4-b1a8-49ef-9c3c-9df719db0477', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-6b0e1d01-575e-4931-806a-be8e17e1c14e req-c76c18af-c27a-4c42-96a6-93f941e0285c tempest-TestMinimumBasicScenario-1852591426 None] attachment_update completed successfully. Sep 23 00:23:00 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 1073741824" returned: 0 in 0.921s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=89,cinder:UPDATE=127,cinder:INSERT=38,cinder:DELETE=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:00 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:00 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:00 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69f28d7-d41e-40e9-8f50-c598eb6c81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4685a6fe-438b-4d5b-b93e-f725ecdb7efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Volume volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 (fcfe8e8b-0b0f-4fed-b95c-f078af535c75): created successfully Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4685a6fe-438b-4d5b-b93e-f725ecdb7efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (7744e43d-ef47-464f-97ec-4fefe6f5bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-22d81e98-010e-41cd-b3d2-3c781fdd4f69 tempest-GroupSnapshotsTest-1853160388 None] Created volume successfully. Sep 23 00:23:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] GroupSnapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: creating. Sep 23 00:23:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Group snapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Creating offline snapshot add33a99-1df4-4a2b-962e-c927df399ddd of volume fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4261021c-fa25-46cf-b795-5cfd9111adab]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:02 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:02 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.616s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd 1G Sep 23 00:23:02 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:03 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd 1G" returned: 0 in 0.863s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:03 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:03 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.566s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:04 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info Sep 23 00:23:04 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info Sep 23 00:23:05 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.info" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.582s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-faf71ed8-feb9-4624-9fc0-1a0d322037fe tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: created successfully Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd-d4c8721d-5338-46f8-b30a-66c36f759710" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd-d4c8721d-5338-46f8-b30a-66c36f759710" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Creating volume d4c8721d-5338-46f8-b30a-66c36f759710 from snapshot add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] snapshot: add33a99-1df4-4a2b-962e-c927df399ddd, volume: d4c8721d-5338-46f8-b30a-66c36f759710, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c456541-a185-4981-9ce0-9749338a27e5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:07 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:07 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:08 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.570s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[32231ff7-78e7-4c94-9285-4851e65f6872]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:08 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:08 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.657s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:23:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 Sep 23 00:23:08 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:17 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:17 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:INSERT=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2e18445-27e7-43e8-9479-65829618c129 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2e18445-27e7-43e8-9479-65829618c129 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" acquired by "attach_volume" :: waited 0.058s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f2e18445-27e7-43e8-9479-65829618c129 tempest-VolumesActionsTest-1854459563 None] Attaching volume e66a2f84-c619-482f-9271-9f70e75b7887 to instance 2e32a0eb-75cc-4f50-9d73-41eb5460674f at mountpoint /dev/vdb on host None. Sep 23 00:23:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f2e18445-27e7-43e8-9479-65829618c129 tempest-VolumesActionsTest-1854459563 None] Attach volume completed successfully. Sep 23 00:23:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2e18445-27e7-43e8-9479-65829618c129 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" released by "attach_volume" :: held 0.390s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5411d080-0b01-4bad-a945-c50ce0ce0882 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5411d080-0b01-4bad-a945-c50ce0ce0882 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" acquired by "detach_volume" :: waited 0.085s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5411d080-0b01-4bad-a945-c50ce0ce0882 tempest-VolumesActionsTest-1854459563 None] Detaching volume e66a2f84-c619-482f-9271-9f70e75b7887 from instance 2e32a0eb-75cc-4f50-9d73-41eb5460674f. Sep 23 00:23:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5411d080-0b01-4bad-a945-c50ce0ce0882 tempest-VolumesActionsTest-1854459563 None] Detach volume completed successfully. Sep 23 00:23:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5411d080-0b01-4bad-a945-c50ce0ce0882 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" released by "detach_volume" :: held 0.336s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:25 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710" returned: 0 in 17.051s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:25 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75, size 1024.00 MB, duration 17.06 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:25 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Converted 1024.00 MB image at 60.04 MB/s Sep 23 00:23:25 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:26 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 Sep 23 00:23:26 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:26 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710" returned: 0 in 0.557s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" released by "_copy_volume_from_snapshot" :: held 18.996s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd-d4c8721d-5338-46f8-b30a-66c36f759710" released by "_create_volume_from_snapshot" :: held 19.143s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 19.178s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-11893266-8225-48d9-a068-5f0ae7f97155 tempest-GroupSnapshotsTest-1853160388 None] Create group from source-snapshot-47d010db-4a0e-4d89-b2ce-a293a76ef73a completed successfully. Sep 23 00:23:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d92a5-7b44-4e37-a863-93dd74204140]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:29 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 Sep 23 00:23:29 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:30 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:30 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710 Sep 23 00:23:30 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:30 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d4c8721d-5338-46f8-b30a-66c36f759710" returned: 0 in 0.335s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-d4c8721d-5338-46f8-b30a-66c36f759710" released by "delete_volume" :: held 0.977s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['1bc2361e-8e5a-4b59-b426-ec23fb88a40d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:23:30 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-3069786 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-3069786, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:30 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-3069786 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-3069786, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['2295daeb-da55-4bdd-b741-14343f6a2298', 'f5e747ba-dbd1-48f9-aa2e-66b9b5e6450d', '44f9343e-9e9b-4873-b3d3-ec9e2da61c43', 'b444a707-829a-4b6d-aa7b-ec808c629d1d', '228620e4-5854-4d2b-810b-f14abb808da4'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:31 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:23:31 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: deleting Sep 23 00:23:31 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c638f857-223f-409d-b0eb-c15db6b7d490 tempest-GroupSnapshotsTest-1853160388 None] Delete group completed successfully. Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Deleting offline snapshot add33a99-1df4-4a2b-962e-c927df399ddd of volume fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] snapshot_file for this snap is: volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac31f99-8884-4f4c-b5e5-1fb291fd7dd1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:32 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:32 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:32 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.543s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d49fd-9120-44d7-86ca-15e880797542]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:32 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:32 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.728s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:33 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:33 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:33 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.784s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:34 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd Sep 23 00:23:34 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:34 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75.add33a99-1df4-4a2b-962e-c927df399ddd" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-add33a99-1df4-4a2b-962e-c927df399ddd" released by "_delete_snapshot" :: held 2.559s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" released by "delete_snapshot" :: held 2.603s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:34 devstack cinder-volume[86731]: WARNING cinder.quota [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-3069786 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-3069786, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['7be79d99-6c57-458e-921d-295f26ee0dc8', '99dca05c-d91b-4677-8974-9b3dd6f4b478', 'b21c43db-7a49-41d2-9d2c-1ab03515853e', 'cab68b12-d438-4542-992e-7eb41f767ea3', '7cf06a6a-0425-4766-9ccd-8b88b823bfa6'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:23:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4dd9cb29-1e6a-43e7-9550-99d10ca2417f tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 47d010db-4a0e-4d89-b2ce-a293a76ef73a: deleted successfully Sep 23 00:23:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a82927-81c2-4cfb-ac3a-5759344e5fbc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:35 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:35 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.562s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:36 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75 Sep 23 00:23:36 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" returned: 0 in 0.515s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-fcfe8e8b-0b0f-4fed-b95c-f078af535c75" released by "delete_volume" :: held 1.210s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['bb04e86f-23d0-4b55-a984-083db98b3901'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:23:37 devstack cinder-volume[86731]: WARNING cinder.db.api [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-3069786'] Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['95e3b062-ebaf-496b-b7d6-3ea98835048f', '698a0db9-9785-4f8e-8ff0-d56399bc1748', 'd5b60b21-86fb-464e-b5e8-2cce238de219', '8421c201-8a39-4338-8090-c51bb6080724', '2a5f8da3-94c2-4696-8f70-87deedd35b22'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:23:37 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:23:37 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:37 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6f07838f-7a4e-46d0-85bd-c75914874287 tempest-GroupSnapshotsTest-1853160388 None] Delete group completed successfully. Sep 23 00:23:38 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.682s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:38 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a2ad1a6-c5a0-494f-b642-af67ce002d4f tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-1730911448: creating Sep 23 00:23:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a2ad1a6-c5a0-494f-b642-af67ce002d4f tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-1730911448: created successfully Sep 23 00:23:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a2ad1a6-c5a0-494f-b642-af67ce002d4f tempest-GroupSnapshotsTest-1853160388 None] Create group completed successfully. Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (4431a843-497a-4a44-ab22-289c5f935484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45a2f49-b0fb-489b-abc2-3543f2f9d9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45a2f49-b0fb-489b-abc2-3543f2f9d9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1433461384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66271cd7-38e1-4659-bdd4-94b3704f673a,host='devstack@QuobyteHD#QuobyteHD',id=1e82fa18-a84f-4be7-9c26-34a33f1edb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:42Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71d2ba2-f4f2-43dc-b0fd-197355134918),volume_type_id=e71d2ba2-f4f2-43dc-b0fd-197355134918)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886e29eb-61c7-439c-87d0-7e8aa4c63aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886e29eb-61c7-439c-87d0-7e8aa4c63aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb17e58-6862-4f20-8e05-8a7c661d1ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb17e58-6862-4f20-8e05-8a7c661d1ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e82fa18-a84f-4be7-9c26-34a33f1edb5f', 'volume_name': 'volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18345bb-18c0-4b5b-a56a-b416f4696917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18345bb-18c0-4b5b-a56a-b416f4696917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5c1feb-421a-4e64-be5e-d6ce6de34d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Volume 1e82fa18-a84f-4be7-9c26-34a33f1edb5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f', 'volume_size': 1} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66271cd7-38e1-4659-bdd4-94b3704f673a,created_at=2026-09-22T22:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1433461384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66271cd7-38e1-4659-bdd4-94b3704f673a,host='devstack@QuobyteHD#QuobyteHD',id=1e82fa18-a84f-4be7-9c26-34a33f1edb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:42Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71d2ba2-f4f2-43dc-b0fd-197355134918),volume_type_id=e71d2ba2-f4f2-43dc-b0fd-197355134918)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Creating volume 1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:41 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:23:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:42 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f 1073741824 Sep 23 00:23:42 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a8a14434-1c1b-4ced-8b63-547fcc97a1b3 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a8a14434-1c1b-4ced-8b63-547fcc97a1b3 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" acquired by "attach_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a8a14434-1c1b-4ced-8b63-547fcc97a1b3 tempest-VolumesActionsTest-1854459563 None] Attaching volume e66a2f84-c619-482f-9271-9f70e75b7887 to instance 78503b6c-7599-4249-93d5-55ff2e8fe616 at mountpoint /dev/vdb on host None. Sep 23 00:23:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a8a14434-1c1b-4ced-8b63-547fcc97a1b3 tempest-VolumesActionsTest-1854459563 None] Attach volume completed successfully. Sep 23 00:23:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a8a14434-1c1b-4ced-8b63-547fcc97a1b3 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887" released by "attach_volume" :: held 0.241s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:42 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f 1073741824" returned: 0 in 0.997s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0ceb760c-50d2-4633-8f4a-cd660f3848c7 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0ceb760c-50d2-4633-8f4a-cd660f3848c7 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0ceb760c-50d2-4633-8f4a-cd660f3848c7 tempest-VolumesActionsTest-1854459563 None] Detaching volume e66a2f84-c619-482f-9271-9f70e75b7887 from instance 78503b6c-7599-4249-93d5-55ff2e8fe616. Sep 23 00:23:43 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f Sep 23 00:23:43 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0ceb760c-50d2-4633-8f4a-cd660f3848c7 tempest-VolumesActionsTest-1854459563 None] Detach volume completed successfully. Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0ceb760c-50d2-4633-8f4a-cd660f3848c7 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-detach_volume" released by "detach_volume" :: held 0.177s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:43 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5c1feb-421a-4e64-be5e-d6ce6de34d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52accb7e-384e-415a-80fb-3aef0f31e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Volume volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f (1e82fa18-a84f-4be7-9c26-34a33f1edb5f): created successfully Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52accb7e-384e-415a-80fb-3aef0f31e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (4431a843-497a-4a44-ab22-289c5f935484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-68b1c534-64a4-421d-a098-ac22995b2ea6 tempest-GroupSnapshotsTest-1853160388 None] Created volume successfully. Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (f751541a-bcea-467c-a16a-c6c1563e5c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0d1498-972c-495a-8820-2b785e971bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0d1498-972c-495a-8820-2b785e971bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648534117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66271cd7-38e1-4659-bdd4-94b3704f673a,host='devstack@QuobyteHD#QuobyteHD',id=b2278fbe-d37a-419c-9526-a4ca5fc92157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:46Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71d2ba2-f4f2-43dc-b0fd-197355134918),volume_type_id=e71d2ba2-f4f2-43dc-b0fd-197355134918)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9967624-3b9a-4e34-841c-81c6f2d9ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9967624-3b9a-4e34-841c-81c6f2d9ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8750ee0-aa30-4241-b64b-21e35c55ed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8750ee0-aa30-4241-b64b-21e35c55ed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2278fbe-d37a-419c-9526-a4ca5fc92157', 'volume_name': 'volume-b2278fbe-d37a-419c-9526-a4ca5fc92157', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b464c1-e1d3-4ea6-acb5-b693751c08f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b464c1-e1d3-4ea6-acb5-b693751c08f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a98c72-7e1c-423e-8134-58b2da12169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Volume b2278fbe-d37a-419c-9526-a4ca5fc92157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2278fbe-d37a-419c-9526-a4ca5fc92157', 'volume_size': 1} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66271cd7-38e1-4659-bdd4-94b3704f673a,created_at=2026-09-22T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-648534117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66271cd7-38e1-4659-bdd4-94b3704f673a,host='devstack@QuobyteHD#QuobyteHD',id=b2278fbe-d37a-419c-9526-a4ca5fc92157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:46Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71d2ba2-f4f2-43dc-b0fd-197355134918),volume_type_id=e71d2ba2-f4f2-43dc-b0fd-197355134918)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Creating volume b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:23:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 1073741824 Sep 23 00:23:45 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (8f530d3d-6a37-4892-b7cc-37823552658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb1f69-2684-41b0-80ea-c71179798e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb1f69-2684-41b0-80ea-c71179798e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726559291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55474240-fe09-4fb5-8930-ec46a4b6ef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:47Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776eab70-ded3-41c9-9695-2aeb273a85d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:46 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776eab70-ded3-41c9-9695-2aeb273a85d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e798dfa9-8f7b-41b9-a5c1-99060e0f0781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e798dfa9-8f7b-41b9-a5c1-99060e0f0781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55474240-fe09-4fb5-8930-ec46a4b6ef1c', 'volume_name': 'volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b1a95a-3283-49e4-bd1d-a78d8e56d62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b1a95a-3283-49e4-bd1d-a78d8e56d62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5378a95-bcda-42d7-bfdf-4f355ff1cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Volume 55474240-fe09-4fb5-8930-ec46a4b6ef1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c', 'volume_size': 1} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 1073741824" returned: 0 in 0.964s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:46 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 Sep 23 00:23:46 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:47 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1726559291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55474240-fe09-4fb5-8930-ec46a4b6ef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:47Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Creating volume 55474240-fe09-4fb5-8930-ec46a4b6ef1c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a98c72-7e1c-423e-8134-58b2da12169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2278fbe-d37a-419c-9526-a4ca5fc92157', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62b0e64-a34d-4975-992b-f39c666b5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:47 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c 1073741824 Sep 23 00:23:47 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Volume volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 (b2278fbe-d37a-419c-9526-a4ca5fc92157): created successfully Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62b0e64-a34d-4975-992b-f39c666b5d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (f751541a-bcea-467c-a16a-c6c1563e5c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c37fd4a8-b48e-4128-b32a-0e5ed7586e4c tempest-GroupSnapshotsTest-1853160388 None] Created volume successfully. Sep 23 00:23:48 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c 1073741824" returned: 0 in 0.701s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:48 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c Sep 23 00:23:48 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-65099981-80b0-4638-b220-97ae8b36c1aa tempest-GroupSnapshotsTest-1853160388 None] Update group completed successfully. Sep 23 00:23:48 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5378a95-bcda-42d7-bfdf-4f355ff1cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33578ee2-1570-44c7-b2bb-798d503f5101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Volume volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c (55474240-fe09-4fb5-8930-ec46a4b6ef1c): created successfully Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33578ee2-1570-44c7-b2bb-798d503f5101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (8f530d3d-6a37-4892-b7cc-37823552658b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-09cd99dd-1fab-4b95-84ad-2c366f2cc81c tempest-AttachVolumeNegativeTest-279379255 None] Created volume successfully. Sep 23 00:23:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6c21b4aa-e263-4a0f-a999-8bea1e2943c9 tempest-GroupSnapshotsTest-1853160388 None] Update group completed successfully. Sep 23 00:23:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f8dc8-f48a-4cb2-bd5c-c086014b3da2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:50 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:23:50 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:50 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90264bed-ecd0-469c-8edb-18b1c9828efe]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:50 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:23:50 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cf84ed52-8e73-44a5-94bb-d08505b90d03 req-3107d21b-67a8-445b-abfa-c6509671522a tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:50 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.482s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.0c325b25-b5ec-4da4-97f6-4689b5ba8df9l303x4ls.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8e419e54-f0d0-46b6-baa1-a742d868dae9 tempest-GroupSnapshotsTest-1853160388 None] Update group completed successfully. Sep 23 00:23:50 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.0c325b25-b5ec-4da4-97f6-4689b5ba8df9l303x4ls.img Sep 23 00:23:50 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cdb4ba74-9569-4656-ae8a-c19a597a0d98 tempest-GroupSnapshotsTest-1853160388 None] Update group completed successfully. Sep 23 00:23:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] GroupSnapshot f0d41c59-7b02-43f6-978f-2f18243db790: creating. Sep 23 00:23:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Group snapshot f0d41c59-7b02-43f6-978f-2f18243db790: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:23:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:57 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.0c325b25-b5ec-4da4-97f6-4689b5ba8df9l303x4ls.img" returned: 0 in 6.545s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7d9b4e-6b36-46d3-a6e6-34711a682e4a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:23:57 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.604s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.0c325b25-b5ec-4da4-97f6-4689b5ba8df9l303x4ls.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:58 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Converted 1024.00 MB image at 156.43 MB/s Sep 23 00:23:58 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] 0c325b25-b5ec-4da4-97f6-4689b5ba8df9 was raw, no need to convert to raw {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:24:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=67,cinder:UPDATE=54,cinder:INSERT=14 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:INSERT=11,cinder:SELECT=58,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9628dbd0-2c03-4498-9baa-1341bae28d0f req-82a3f808-1ea6-4735-a6d6-85812f352698 tempest-TestMinimumBasicScenario-1852591426 None] Terminate volume connection completed successfully. Sep 23 00:24:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9628dbd0-2c03-4498-9baa-1341bae28d0f req-82a3f808-1ea6-4735-a6d6-85812f352698 tempest-TestMinimumBasicScenario-1852591426 None] Deleting attachment 920cb6f4-b1a8-49ef-9c3c-9df719db0477. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "cinder-3881a56e-66e3-4b5b-940a-3d0a2d1c008d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "cinder-3881a56e-66e3-4b5b-940a-3d0a2d1c008d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "cinder-quobyte-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "cinder-quobyte-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4ff83-8712-4b76-be26-53381e4041a2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d Sep 23 00:24:19 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.479s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Uploaded volume to glance image-id: 0c325b25-b5ec-4da4-97f6-4689b5ba8df9. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cf84ed52-8e73-44a5-94bb-d08505b90d03 req-3107d21b-67a8-445b-abfa-c6509671522a tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.719s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" returned: 0 in 0.672s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0b6cd8e0-d166-4ba1-b1d9-dd183eab2da5 tempest-VolumesActionsTest-1854459563 None] Copy volume to image completed successfully. Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cf84ed52-8e73-44a5-94bb-d08505b90d03 req-3107d21b-67a8-445b-abfa-c6509671522a tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.279s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:20 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Creating offline snapshot 33f9d456-f2ec-481c-8ffd-a6559cc68e12 of volume 1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:20 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-cf84ed52-8e73-44a5-94bb-d08505b90d03 req-3107d21b-67a8-445b-abfa-c6509671522a tempest-AttachVolumeNegativeTest-279379255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd83cec3b-54ff-4f0c-b09a-0e73992d545c', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a81c5-69b3-4140-b039-7227418b5159]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-cf84ed52-8e73-44a5-94bb-d08505b90d03 req-3107d21b-67a8-445b-abfa-c6509671522a tempest-AttachVolumeNegativeTest-279379255 None] attachment_update completed successfully. Sep 23 00:24:20 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f Sep 23 00:24:20 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "cinder-quobyte-3881a56e-66e3-4b5b-940a-3d0a2d1c008d" released by "delete_volume" :: held 1.090s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Created reservations ['49b479ab-48f8-4b7f-ba75-bbcdaffb7299', 'b743c973-39e1-4084-8da0-11b69cbbf909', '1e65bd23-e365-4be0-8215-fa1a085d8d48', '966df0f2-f046-400a-87b1-5bc510192e82', '4a125e66-1bb2-4d7b-b4be-42ce2b74571d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:21 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:24:21 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 1G Sep 23 00:24:21 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Deleted volume successfully. Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2920d1ab-97ea-442f-968c-03a5dadd2c83 tempest-TestMinimumBasicScenario-1852591426 None] Lock "cinder-3881a56e-66e3-4b5b-940a-3d0a2d1c008d-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 1G" returned: 0 in 0.575s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 Sep 23 00:24:21 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:22 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:22 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:22 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 Sep 23 00:24:22 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:22 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:22 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info Sep 23 00:24:22 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:22 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info Sep 23 00:24:23 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.info" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Creating offline snapshot b953dc1f-4e93-479b-9942-dfbe3b6f70b1 of volume b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c33cc2-b63a-42cd-ad0a-48453fbbf2e3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 Sep 23 00:24:23 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157" returned: 0 in 0.742s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 1G Sep 23 00:24:24 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 1G" returned: 0 in 0.625s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 Sep 23 00:24:24 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 Sep 23 00:24:25 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info Sep 23 00:24:25 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info" returned: 0 in 0.337s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:26 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info Sep 23 00:24:26 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.info" returned: 0 in 0.369s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.730s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[72890ba5-86b5-4bdd-b50d-2eba79280292]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:26 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:24:26 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-36244c07-2a71-47e9-9a85-28cf8b7ec2a7 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot f0d41c59-7b02-43f6-978f-2f18243db790: created successfully Sep 23 00:24:27 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.528s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec995019-30df-4cc1-8e3a-495db7ed5277]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:27 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:24:27 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot f0d41c59-7b02-43f6-978f-2f18243db790: deleting Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot f0d41c59-7b02-43f6-978f-2f18243db790: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:27 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-33f9d456-f2ec-481c-8ffd-a6559cc68e12" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.654s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-33f9d456-f2ec-481c-8ffd-a6559cc68e12" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:27 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img Sep 23 00:24:27 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Deleting offline snapshot 33f9d456-f2ec-481c-8ffd-a6559cc68e12 of volume 1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] snapshot_file for this snap is: volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c730a-91ee-4165-a560-78af40247a01]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:28 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 Sep 23 00:24:28 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:29 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12" returned: 0 in 1.028s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65701e-d3dc-4774-8289-fda022f0631d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f Sep 23 00:24:29 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" returned: 0 in 1.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:30 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 Sep 23 00:24:30 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12" returned: 0 in 1.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12 Sep 23 00:24:31 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:32 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f.33f9d456-f2ec-481c-8ffd-a6559cc68e12" returned: 0 in 0.918s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-33f9d456-f2ec-481c-8ffd-a6559cc68e12" released by "_delete_snapshot" :: held 4.972s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" released by "delete_snapshot" :: held 5.059s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-b953dc1f-4e93-479b-9942-dfbe3b6f70b1" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b953dc1f-4e93-479b-9942-dfbe3b6f70b1" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Deleting offline snapshot b953dc1f-4e93-479b-9942-dfbe3b6f70b1 of volume b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] snapshot_file for this snap is: volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5603f128-95a2-4727-861c-0b9e1352d2d4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 Sep 23 00:24:33 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1" returned: 0 in 1.144s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2278fbe-d37a-419c-9526-a4ca5fc92157(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f56917-cab4-403c-8dc2-b90967f8ab3c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 Sep 23 00:24:34 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:35 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157" returned: 0 in 0.974s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 Sep 23 00:24:35 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1" returned: 0 in 0.884s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:36 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1 Sep 23 00:24:36 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:37 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157.b953dc1f-4e93-479b-9942-dfbe3b6f70b1" returned: 0 in 0.696s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b953dc1f-4e93-479b-9942-dfbe3b6f70b1" released by "_delete_snapshot" :: held 4.016s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" released by "delete_snapshot" :: held 4.093s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:37 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1604397868 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1604397868, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:37 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1604397868 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1604397868, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:37 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:24:37 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['511d26f1-b633-4567-a618-9426d90c6db9', 'f58c4787-ac19-4fdf-af11-2d0eaed6286f', '3b05527e-61c7-475c-9cfc-4ea17392d5fb', 'ab5d3a98-54af-4f46-a11c-b0ea06dc47dd', 'fb1ab271-9250-46cf-a24b-ab17113b6bf9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['4820cc39-bbfd-4ab2-aa8d-d418ace23b21', '08d27bcc-9d0f-4497-adf2-b90f83c138dc', 'edabe492-f442-4b7e-8970-d43266be146b', '93c75878-dcb0-4822-9fcb-479b580b9762', '57f9f132-0c3d-467a-888d-bc497aabea1f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ccc4b12f-297e-4c44-8982-6f011a26af71 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot f0d41c59-7b02-43f6-978f-2f18243db790: deleted successfully Sep 23 00:24:38 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.897s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:24:38 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img" returned: 0 in 11.055s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d2d576-1587-4716-b715-788e4578e916]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:39 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:24:39 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3789c21-dc2a-4201-a957-fe38b74ca28c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:39 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f Sep 23 00:24:39 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:39 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.998s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:39 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887, size 1024.00 MB, duration 11.06 sec, destination /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:24:39 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Converted 1024.00 MB image at 92.62 MB/s Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] 15aa3fcf-2b56-41e5-8637-f5e2ce3d7e59 was raw, converting to qcow2 {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30679288-b65d-4131-8dca-fe9d27b81518]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" returned: 0 in 0.770s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f Sep 23 00:24:40 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:40 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img Sep 23 00:24:40 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:40 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-1e82fa18-a84f-4be7-9c26-34a33f1edb5f" released by "delete_volume" :: held 1.365s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[187280ac-1460-4de2-a8d3-1aee065cfa69]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img" returned: 0 in 0.804s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 Sep 23 00:24:41 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img Sep 23 00:24:41 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img" returned: 1 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:24:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img /opt/stack/data/cinder/conversion/vol_upload_auac2e9l {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img /opt/stack/data/cinder/conversion/vol_upload_auac2e9l Sep 23 00:24:41 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157" returned: 0 in 0.731s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157 Sep 23 00:24:41 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:42 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b2278fbe-d37a-419c-9526-a4ca5fc92157" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-b2278fbe-d37a-419c-9526-a4ca5fc92157" released by "delete_volume" :: held 1.459s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:42 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img /opt/stack/data/cinder/conversion/vol_upload_auac2e9l" returned: 0 in 0.765s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Image conversion details: src /opt/stack/data/cinder/conversion/e66a2f84-c619-482f-9271-9f70e75b7887.temp_image.15aa3fcf-2b56-41e5-8637-f5e2ce3d7e592m52kgez.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_auac2e9l {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:24:42 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9235f0a-4ee0-4876-bdc7-8fdef594f4e2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_auac2e9l {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['0022690c-f03a-45cf-aa57-d2a073ff59fe'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:42 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1604397868 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1604397868, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:42 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_auac2e9l Sep 23 00:24:42 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['0439fab3-3472-4efe-a7a0-f29677977c5d', '6170dda8-aa45-455f-b045-4c5725df131b', 'd4bcf59b-a959-4647-b902-d10f84ee3a61', '356d62a6-9fbb-4027-ab61-faef5381361c', '4af22edc-dbea-4836-9d8b-13b2e4b67cc6'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['1647dfeb-5030-4193-9335-f183820897bf', 'f59a1e35-29b6-4929-ab5b-e2e510da226d', 'bcd4bfd3-070b-46c9-a1c2-15740780a716', '48353c6e-8304-4718-9a33-dd2c164cf1a0', 'a22e8d70-b9da-4653-b52d-2e2db1f7b707'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:43 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_auac2e9l" returned: 0 in 0.873s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:43 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:24:43 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:43 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.667s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ba9814a8-877f-4c52-a107-f1bc7cef92e2 tempest-GroupSnapshotsTest-1853160388 None] Delete group completed successfully. Sep 23 00:24:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4ffc6b1e-0195-4af5-a649-4beae93ab8d6 tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-1115145606: creating Sep 23 00:24:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4ffc6b1e-0195-4af5-a649-4beae93ab8d6 tempest-GroupSnapshotsTest-1853160388 None] Group tempest-GroupSnapshotsTest-Group-1115145606: created successfully Sep 23 00:24:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4ffc6b1e-0195-4af5-a649-4beae93ab8d6 tempest-GroupSnapshotsTest-1853160388 None] Create group completed successfully. Sep 23 00:24:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 19.560s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Uploaded volume to glance image-id: 15aa3fcf-2b56-41e5-8637-f5e2ce3d7e59. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:24:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f5c06ac9-e160-4301-972d-86f017ddaa7b tempest-VolumesActionsTest-1854459563 None] Copy volume to image completed successfully. Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (7bdbc659-c2cc-4256-b573-5a1842a30d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f618ee2-bf8d-44b7-8269-7dc403c4ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f618ee2-bf8d-44b7-8269-7dc403c4ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-270013774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ddd3c27-9451-44fc-a7bd-715bdc4593e0,host='devstack@QuobyteHD#QuobyteHD',id=2436bb4b-d3bc-4a83-aed7-2f136e298bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:47Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23c879a-6c91-4f2e-bf7a-b59bd7555e4e),volume_type_id=f23c879a-6c91-4f2e-bf7a-b59bd7555e4e)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb25d4c-8a55-4a3e-b92d-d5d907b00534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb25d4c-8a55-4a3e-b92d-d5d907b00534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc878d20-f1e0-4e3c-889a-b14da65ef6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc878d20-f1e0-4e3c-889a-b14da65ef6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2436bb4b-d3bc-4a83-aed7-2f136e298bb7', 'volume_name': 'volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f87977-26b9-462f-9bd0-aaf4b4f55944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f87977-26b9-462f-9bd0-aaf4b4f55944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32805c2-c68e-4320-99d3-27c28893cf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Volume 2436bb4b-d3bc-4a83-aed7-2f136e298bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7', 'volume_size': 1} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ddd3c27-9451-44fc-a7bd-715bdc4593e0,created_at=2026-09-22T22:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-270013774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ddd3c27-9451-44fc-a7bd-715bdc4593e0,host='devstack@QuobyteHD#QuobyteHD',id=2436bb4b-d3bc-4a83-aed7-2f136e298bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917a625eb91e49ef8bdf0cbab30859a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:47Z,use_quota=True,user_id='943d77a1db5747f9b599bf14e32876ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f23c879a-6c91-4f2e-bf7a-b59bd7555e4e),volume_type_id=f23c879a-6c91-4f2e-bf7a-b59bd7555e4e)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Creating volume 2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:47 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 1073741824 Sep 23 00:24:47 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "cinder-quobyte-e66a2f84-c619-482f-9271-9f70e75b7887" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-quobyte-e66a2f84-c619-482f-9271-9f70e75b7887" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d88e9fb-84df-4363-9af4-9dce4de65d56]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 1073741824" returned: 0 in 0.947s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:24:48 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 Sep 23 00:24:48 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.826s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:49 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887 Sep 23 00:24:49 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:49 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" returned: 0 in 0.839s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32805c2-c68e-4320-99d3-27c28893cf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10126a0f-f706-48d8-838b-dda6b59d58e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Volume volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 (2436bb4b-d3bc-4a83-aed7-2f136e298bb7): created successfully Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10126a0f-f706-48d8-838b-dda6b59d58e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Flow 'volume_create_manager' (7bdbc659-c2cc-4256-b573-5a1842a30d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3146c31c-6f73-41fe-8c81-b45363c733ca tempest-GroupSnapshotsTest-1853160388 None] Created volume successfully. Sep 23 00:24:49 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e66a2f84-c619-482f-9271-9f70e75b7887" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-quobyte-e66a2f84-c619-482f-9271-9f70e75b7887" released by "delete_volume" :: held 1.331s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Created reservations ['ea977a34-83f2-4c84-b9a2-65431d115112', 'c6018ee3-0cd5-44d3-a447-8a66f60f6474', '676e5a4c-18e8-4684-9f06-4d332412cc51', 'bb733dc6-93c4-4f3d-a83c-aa141378eda0', '83ba3f45-5068-444b-a5a2-365e172faaf5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:49 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:24:49 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Deleted volume successfully. Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d41d2e9a-aaec-40ac-995d-219cff5df5d0 tempest-VolumesActionsTest-1854459563 None] Lock "cinder-e66a2f84-c619-482f-9271-9f70e75b7887-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] GroupSnapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: creating. Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Group snapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Creating offline snapshot 7f55afc2-6e5b-49aa-85f2-f555367b5259 of volume 2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044becb-c673-4cb2-8d3e-678e1bdefb17]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 Sep 23 00:24:51 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:51 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" returned: 0 in 0.694s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 1G Sep 23 00:24:51 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 1G" returned: 0 in 0.841s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 Sep 23 00:24:52 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (539861c0-4d2d-43b5-98f1-64396e2c862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539212f6-c13b-4c25-809a-563a2c8a055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539212f6-c13b-4c25-809a-563a2c8a055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120646369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb88747e-6e5a-4bf7-9a1a-41c1be424380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:53Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d7c1e-6bd3-4051-9263-1448af9fd4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d7c1e-6bd3-4051-9263-1448af9fd4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5106f4b-42d2-413c-9bd3-ac2d470abbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5106f4b-42d2-413c-9bd3-ac2d470abbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb88747e-6e5a-4bf7-9a1a-41c1be424380', 'volume_name': 'volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616210cd-74aa-4026-b326-569b3726ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616210cd-74aa-4026-b326-569b3726ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acc61f5-cd9e-4c56-a0b8-b77f4008a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume bb88747e-6e5a-4bf7-9a1a-41c1be424380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380', 'volume_size': 1} Sep 23 00:24:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:53 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259" returned: 0 in 0.638s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 Sep 23 00:24:53 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info Sep 23 00:24:53 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info" returned: 0 in 0.469s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:24:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info Sep 23 00:24:53 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:54 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.info" returned: 0 in 0.424s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120646369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb88747e-6e5a-4bf7-9a1a-41c1be424380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:53Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:24:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:54 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 1073741824 Sep 23 00:24:54 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8a8821fd-a226-40d8-948d-c1bab8f0feac tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: created successfully Sep 23 00:24:55 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 1073741824" returned: 0 in 0.667s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 Sep 23 00:24:55 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acc61f5-cd9e-4c56-a0b8-b77f4008a757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d45912-bf2e-420d-bf07-d8ec1aef1a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: deleting Sep 23 00:24:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 (bb88747e-6e5a-4bf7-9a1a-41c1be424380): created successfully Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d45912-bf2e-420d-bf07-d8ec1aef1a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (539861c0-4d2d-43b5-98f1-64396e2c862d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:24:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d30569e1-f1dc-4c95-8cba-88e323c3c76c tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-7f55afc2-6e5b-49aa-85f2-f555367b5259" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-7f55afc2-6e5b-49aa-85f2-f555367b5259" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Deleting offline snapshot 7f55afc2-6e5b-49aa-85f2-f555367b5259 of volume 2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] snapshot_file for this snap is: volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e2571-fd2d-461a-b4d5-06e8950fdc6d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 Sep 23 00:24:56 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating offline snapshot 55b019a9-3e57-4b02-ad98-cf0dafd12415 of volume bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:56 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068c84e-5660-4560-a17f-8e766872c3d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259" returned: 0 in 0.653s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a39e09-d29b-4d55-9664-16a6355a65a0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 Sep 23 00:24:56 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 Sep 23 00:24:56 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:57 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380" returned: 0 in 0.616s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:57 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 1G Sep 23 00:24:57 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:57 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" returned: 0 in 0.602s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:57 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 Sep 23 00:24:57 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:57 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:57 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259 Sep 23 00:24:57 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:57 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 1G" returned: 0 in 0.708s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:57 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 Sep 23 00:24:57 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:58 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7.7f55afc2-6e5b-49aa-85f2-f555367b5259" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-7f55afc2-6e5b-49aa-85f2-f555367b5259" released by "_delete_snapshot" :: held 2.326s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" released by "delete_snapshot" :: held 2.358s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:58 devstack cinder-volume[86731]: WARNING cinder.quota [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-126294398 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-126294398, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:58 devstack cinder-volume[86731]: WARNING cinder.quota [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-126294398 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-126294398, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:24:58 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:58 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 is being set with open permissions: ugo+rw Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['9e681e7d-9a17-4797-af6f-7d7254130d14', 'efa45f9b-51cd-4cde-be86-8a308efdcdfd', '2c6a1487-d0ae-4b23-ab09-d47dc0724b3a', '379c2e24-380a-4a4f-8613-5cd16db5301a', '4806b6d7-85a0-461b-9f8e-796938c3ccc7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:24:58 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 Sep 23 00:24:58 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-97ceb500-f624-4a23-9697-1c9c5a384f33 tempest-GroupSnapshotsTest-1853160388 None] group_snapshot 0fd8f1f3-f8bb-43c2-a8ae-4083bbb46814: deleted successfully Sep 23 00:24:58 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:58 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info Sep 23 00:24:58 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:58 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:58 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info is being set with open permissions: ugo+rw Sep 23 00:24:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:59 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info Sep 23 00:24:59 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:59 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.info" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0b63fc3b-c275-4d0d-a5a1-4b84fda86d5a tempest-CreateVolumesFromSnapshotTest-944021278 None] Create snapshot completed successfully Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" acquired by "delete_volume" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81eb4c0-8bc5-4d11-8acc-4630b5cc7408]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 Sep 23 00:25:00 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (9c9481fc-f1b3-46dd-bb9d-2a899c543caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a79a9f-18b3-41a0-9757-2c5a025b1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a79a9f-18b3-41a0-9757-2c5a025b1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438764313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5c54fb-377a-468a-ae9f-5d2a41be3c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:00Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f696b2ac-0e91-433b-944f-a3b70e3543ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f696b2ac-0e91-433b-944f-a3b70e3543ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b412b-931f-4cf2-9486-44c78425a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7b412b-931f-4cf2-9486-44c78425a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5c54fb-377a-468a-ae9f-5d2a41be3c78', 'volume_name': 'volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad430456-c29b-45ae-993d-82a243b563b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad430456-c29b-45ae-993d-82a243b563b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b9438d-fce0-4a94-bf60-16b53ae57114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume dd5c54fb-377a-468a-ae9f-5d2a41be3c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78', 'volume_size': 1} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1438764313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5c54fb-377a-468a-ae9f-5d2a41be3c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:00Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume dd5c54fb-377a-468a-ae9f-5d2a41be3c78 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:00 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" returned: 0 in 0.598s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 1073741824 Sep 23 00:25:00 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7 Sep 23 00:25:00 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Lock "cinder-quobyte-2436bb4b-d3bc-4a83-aed7-2f136e298bb7" released by "delete_volume" :: held 1.142s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (1675e840-aca0-41d5-ad46-ce92fb4b53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bea4cd8-58b0-4927-9cea-b8e6483c079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bea4cd8-58b0-4927-9cea-b8e6483c079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1792026978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d908c2-750e-4a0d-9435-65192d8f64a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:01Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe55057-06d3-491d-bec2-3278d1b3af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe55057-06d3-491d-bec2-3278d1b3af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77534b4-cb02-4a16-8e5c-ecebb953dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77534b4-cb02-4a16-8e5c-ecebb953dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d908c2-750e-4a0d-9435-65192d8f64a4', 'volume_name': 'volume-e4d908c2-750e-4a0d-9435-65192d8f64a4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007a565-69f8-470a-96cb-4edfd6f8961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007a565-69f8-470a-96cb-4edfd6f8961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db313dd3-02db-48bf-ab67-1fa56e1997f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume e4d908c2-750e-4a0d-9435-65192d8f64a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d908c2-750e-4a0d-9435-65192d8f64a4', 'volume_size': 1} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['88a6865c-b5e4-4e83-bd4d-c3766a2d670f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:01 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 1073741824" returned: 0 in 0.759s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:01 devstack cinder-volume[86731]: WARNING cinder.quota [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-126294398 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-126294398, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Created reservations ['51ba3d85-3a01-486f-b267-10a72ea3105a', 'c6deb9e2-98d6-4a10-ba4a-970db1e2ec26', '3130f3f0-a8cc-440d-baec-3d1928dba2e4', '2ca6ed77-e9dd-4f56-b818-c055cb1a8b9b', 'cce4573c-0d5e-4e13-b491-288ebb486587'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:01 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 Sep 23 00:25:01 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:01 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:01 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:01 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1792026978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d908c2-750e-4a0d-9435-65192d8f64a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:01Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume e4d908c2-750e-4a0d-9435-65192d8f64a4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:01 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:01 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 1073741824 Sep 23 00:25:01 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (e7aad19c-1ac4-4a7b-9130-973876a34cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d7ee55-48a4-497a-9658-73ef995983ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b9438d-fce0-4a94-bf60-16b53ae57114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649e86eb-cefd-4c3f-99be-962574ece921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d7ee55-48a4-497a-9658-73ef995983ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354130178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e006a1f-7dd2-422b-98d6-7890cfa9559b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:02Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ad5d07-ad71-4313-9622-8fee3e460ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ad5d07-ad71-4313-9622-8fee3e460ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a66bfb3-0c00-4d8b-8545-ee5361267be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a66bfb3-0c00-4d8b-8545-ee5361267be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e006a1f-7dd2-422b-98d6-7890cfa9559b', 'volume_name': 'volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbf6e28-6cd9-4e6b-9dcf-8cf87db627b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbf6e28-6cd9-4e6b-9dcf-8cf87db627b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1fe4d-0549-4289-92e6-17b0aa44fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume 6e006a1f-7dd2-422b-98d6-7890cfa9559b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b', 'volume_size': 1} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 (dd5c54fb-377a-468a-ae9f-5d2a41be3c78): created successfully Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649e86eb-cefd-4c3f-99be-962574ece921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (9c9481fc-f1b3-46dd-bb9d-2a899c543caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:02 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.681s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-57fbc109-5f74-45f0-9013-85a3db85ca80 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:25:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-250d29b9-d4c1-49db-9aa9-45dca45a7d55 tempest-GroupSnapshotsTest-1853160388 None] Delete group completed successfully. Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (1dfc8063-eed0-4230-97ed-342a303dc855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19492c82-004f-45e1-800f-a274a378affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19492c82-004f-45e1-800f-a274a378affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148616811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860d76e9-41d9-4365-87e5-e547978c1776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:03Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc514b48-9e93-47da-af22-6746a90fcbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc514b48-9e93-47da-af22-6746a90fcbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8404dff7-1b06-4392-8e1e-94e6c45150c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8404dff7-1b06-4392-8e1e-94e6c45150c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860d76e9-41d9-4365-87e5-e547978c1776', 'volume_name': 'volume-860d76e9-41d9-4365-87e5-e547978c1776', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39048b1e-21ec-4fbd-91e8-8e37adefd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39048b1e-21ec-4fbd-91e8-8e37adefd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbce697-cd3a-436b-b86f-9dbb3d0a5f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume 860d76e9-41d9-4365-87e5-e547978c1776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860d76e9-41d9-4365-87e5-e547978c1776', 'volume_size': 1} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:02 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 1073741824" returned: 0 in 1.080s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:03 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 Sep 23 00:25:03 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:03 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354130178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e006a1f-7dd2-422b-98d6-7890cfa9559b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:02Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume 6e006a1f-7dd2-422b-98d6-7890cfa9559b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db313dd3-02db-48bf-ab67-1fa56e1997f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d908c2-750e-4a0d-9435-65192d8f64a4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29572a68-74a5-43ad-a12a-f97d2e8c3440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b 1073741824 Sep 23 00:25:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 (e4d908c2-750e-4a0d-9435-65192d8f64a4): created successfully Sep 23 00:25:03 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29572a68-74a5-43ad-a12a-f97d2e8c3440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (1675e840-aca0-41d5-ad46-ce92fb4b53d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-97a4aa86-2af6-4139-8bca-d76ce9040e68 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (d6d2fcf4-eec4-4c40-830d-b324c243ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97504a48-71b6-47c4-b4db-4f0c31d9a555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97504a48-71b6-47c4-b4db-4f0c31d9a555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665029426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063de09c-c16c-4c83-b23c-02a0045589c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:04Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ad2db9-942d-4a7d-b0a3-1c9fb0868469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ad2db9-942d-4a7d-b0a3-1c9fb0868469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d4adf4-4efc-4373-a6cc-1181fab7959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d4adf4-4efc-4373-a6cc-1181fab7959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063de09c-c16c-4c83-b23c-02a0045589c8', 'volume_name': 'volume-063de09c-c16c-4c83-b23c-02a0045589c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad94a2b9-74a3-48bb-892a-828cbd79283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad94a2b9-74a3-48bb-892a-828cbd79283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b97b6e-2170-4491-b13c-288e84acda74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume 063de09c-c16c-4c83-b23c-02a0045589c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063de09c-c16c-4c83-b23c-02a0045589c8', 'volume_size': 1} Sep 23 00:25:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:04 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b 1073741824" returned: 0 in 0.905s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:04 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b Sep 23 00:25:04 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:04 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148616811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860d76e9-41d9-4365-87e5-e547978c1776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:03Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume 860d76e9-41d9-4365-87e5-e547978c1776 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a1fe4d-0549-4289-92e6-17b0aa44fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 1073741824 Sep 23 00:25:04 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85191a46-e43b-4a6a-84c6-93bd597fc71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b (6e006a1f-7dd2-422b-98d6-7890cfa9559b): created successfully Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85191a46-e43b-4a6a-84c6-93bd597fc71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (e7aad19c-1ac4-4a7b-9130-973876a34cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3a42dc94-656e-42d1-8e63-1b0f69767c70 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Flow 'volume_create_manager' (aeb86c0b-066b-461c-b044-e34e706b5699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119eda4-2d50-4f21-99f8-bd1518eb2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119eda4-2d50-4f21-99f8-bd1518eb2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-259126272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d099d46-747c-4359-a712-ee2de9a1c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2eb21bd3bd84764a1586fc59dabbd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:05Z,use_quota=True,user_id='bf0aba95414e4a418917e76401765e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e50d9-6d78-4f45-95b1-f07257441884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e50d9-6d78-4f45-95b1-f07257441884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5aafe57-161e-4ff3-b04e-24c684e1ae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5aafe57-161e-4ff3-b04e-24c684e1ae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d099d46-747c-4359-a712-ee2de9a1c96b', 'volume_name': 'volume-9d099d46-747c-4359-a712-ee2de9a1c96b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc24833b-442d-4e73-9599-d1fc9572f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc24833b-442d-4e73-9599-d1fc9572f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f15961-e3eb-4ce9-9311-30145b9c603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Volume 9d099d46-747c-4359-a712-ee2de9a1c96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d099d46-747c-4359-a712-ee2de9a1c96b', 'volume_size': 1} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:05 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 1073741824" returned: 0 in 0.661s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:05 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 Sep 23 00:25:05 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:05 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776" returned: 0 in 0.418s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665029426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063de09c-c16c-4c83-b23c-02a0045589c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922621ba49b42f28bfebc25394feb56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:04Z,use_quota=True,user_id='1ee646258b9641bdb3b01a5bb9109cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Creating volume 063de09c-c16c-4c83-b23c-02a0045589c8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:06 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 1073741824 Sep 23 00:25:06 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbce697-cd3a-436b-b86f-9dbb3d0a5f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860d76e9-41d9-4365-87e5-e547978c1776', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01b3905-3dff-4a54-b367-def1180e740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-860d76e9-41d9-4365-87e5-e547978c1776 (860d76e9-41d9-4365-87e5-e547978c1776): created successfully Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01b3905-3dff-4a54-b367-def1180e740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (1dfc8063-eed0-4230-97ed-342a303dc855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-79e4c3b7-e4bc-44c7-a0e9-7cdb1c13bf04 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:25:06 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 1073741824" returned: 0 in 0.735s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:06 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 Sep 23 00:25:06 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.993s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-259126272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d099d46-747c-4359-a712-ee2de9a1c96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2eb21bd3bd84764a1586fc59dabbd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:05Z,use_quota=True,user_id='bf0aba95414e4a418917e76401765e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Creating volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b97b6e-2170-4491-b13c-288e84acda74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063de09c-c16c-4c83-b23c-02a0045589c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b 1073741824 Sep 23 00:25:07 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482ad1ba-1568-4342-a632-38a1384a3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Volume volume-063de09c-c16c-4c83-b23c-02a0045589c8 (063de09c-c16c-4c83-b23c-02a0045589c8): created successfully Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482ad1ba-1568-4342-a632-38a1384a3402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Flow 'volume_create_manager' (d6d2fcf4-eec4-4c40-830d-b324c243ba04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-af6dcf49-b694-440b-845b-d0ecaf6afaeb tempest-CreateVolumesFromSnapshotTest-944021278 None] Created volume successfully. Sep 23 00:25:07 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b 1073741824" returned: 0 in 0.727s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:07 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b Sep 23 00:25:07 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-063de09c-c16c-4c83-b23c-02a0045589c8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:08 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-063de09c-c16c-4c83-b23c-02a0045589c8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f15961-e3eb-4ce9-9311-30145b9c603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d099d46-747c-4359-a712-ee2de9a1c96b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc7f2d8-5367-4401-b3df-dbae6d283cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Volume volume-9d099d46-747c-4359-a712-ee2de9a1c96b (9d099d46-747c-4359-a712-ee2de9a1c96b): created successfully Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc7f2d8-5367-4401-b3df-dbae6d283cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Flow 'volume_create_manager' (aeb86c0b-066b-461c-b044-e34e706b5699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-063de09c-c16c-4c83-b23c-02a0045589c8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-43de565a-a8be-4482-9ce6-56c5bb92a51d tempest-VolumesSnapshotListTestJSON-1644222813 None] Created volume successfully. Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-063de09c-c16c-4c83-b23c-02a0045589c8" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2900dad3-b089-4382-b425-71d46a36c52a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:08 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 Sep 23 00:25:08 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8" returned: 0 in 0.627s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8 Sep 23 00:25:09 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Creating offline snapshot 0771c674-26ea-4c51-acd6-593c8e547d4e of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea99e9a-3a53-40f2-ad1f-ef106658ae63]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:09 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b Sep 23 00:25:09 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-063de09c-c16c-4c83-b23c-02a0045589c8" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-063de09c-c16c-4c83-b23c-02a0045589c8" released by "delete_volume" :: held 1.263s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['b012617d-bea6-45b6-b890-42d1c4582721', 'ea76a5f3-4e2e-47b3-a1a5-0135c34531a9', 'e009da9c-d69a-43f3-be00-aec6b90ab9b5', '5a04dcca-f36a-4985-ba46-8b465859d787', '82dbc90c-5365-4c5f-b89e-8260dffa2e85'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:10 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b" returned: 0 in 0.604s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e 1G Sep 23 00:25:10 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f76027fd-26c7-4816-89a9-bf21b9a6b38e tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-063de09c-c16c-4c83-b23c-02a0045589c8-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-860d76e9-41d9-4365-87e5-e547978c1776-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-860d76e9-41d9-4365-87e5-e547978c1776-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-860d76e9-41d9-4365-87e5-e547978c1776" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-860d76e9-41d9-4365-87e5-e547978c1776" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772078f-f171-490b-a64d-d4bf0ea563d8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e 1G" returned: 0 in 0.746s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:11 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 Sep 23 00:25:11 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e is being set with open permissions: ugo+rw Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:11 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776" returned: 0 in 0.563s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776 Sep 23 00:25:11 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info Sep 23 00:25:11 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-860d76e9-41d9-4365-87e5-e547978c1776" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-860d76e9-41d9-4365-87e5-e547978c1776" released by "delete_volume" :: held 0.950s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['6d290cbf-73de-4c2f-a59a-87e045f5e5be', '7d5ac265-8417-494b-8271-229b4db81a3b', '79eada83-d12f-4ee3-9416-57dc438b8955', '4d9cd366-98e0-43d9-8387-a25bc765fd6d', '9a46a9d2-a459-4eec-9d8d-b1f8aa559bf0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:12 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info is being set with open permissions: ugo+rw Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info Sep 23 00:25:12 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:12 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.info" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6e245558-129e-492e-a184-cb69e9e228d4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-860d76e9-41d9-4365-87e5-e547978c1776-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-569c18a4-61bb-4e64-a521-1f3f9a92592c tempest-VolumesSnapshotListTestJSON-1644222813 None] Create snapshot completed successfully Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-6e006a1f-7dd2-422b-98d6-7890cfa9559b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-6e006a1f-7dd2-422b-98d6-7890cfa9559b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-6e006a1f-7dd2-422b-98d6-7890cfa9559b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-6e006a1f-7dd2-422b-98d6-7890cfa9559b" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb95ff5-7030-47bf-a7e4-926ac267a542]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b Sep 23 00:25:13 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b" returned: 0 in 0.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b Sep 23 00:25:13 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Creating offline snapshot d625b5de-f883-4152-89bd-5b584a60e311 of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d209b49a-a317-41ca-816d-0a14a206a1f1 req-0ea3929b-f257-4d18-949d-2608db565e56 tempest-AttachVolumeNegativeTest-279379255 None] Terminate volume connection completed successfully. Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d209b49a-a317-41ca-816d-0a14a206a1f1 req-0ea3929b-f257-4d18-949d-2608db565e56 tempest-AttachVolumeNegativeTest-279379255 None] Deleting attachment d83cec3b-54ff-4f0c-b09a-0e73992d545c. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:14 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6e006a1f-7dd2-422b-98d6-7890cfa9559b" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db8f796-8b02-4e84-899e-9f9bc53b4cb8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-6e006a1f-7dd2-422b-98d6-7890cfa9559b" released by "delete_volume" :: held 1.063s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['b57fe930-2104-4555-9714-d737973030d8', '40e8e638-c574-4a56-95b8-ca9ddf0625e7', '02b484db-4a29-40a7-bdb6-306e72dea28b', '9f1a0c3b-5271-4dfd-9cac-558f28854870', '9954db57-7ca1-4c93-a3c4-42c1023ad6e1'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:14 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:14 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:14 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:14 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.697s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 1G Sep 23 00:25:15 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.493s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04e19a54-794b-428d-ba29-382bdfd13b2d tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-6e006a1f-7dd2-422b-98d6-7890cfa9559b-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-e4d908c2-750e-4a0d-9435-65192d8f64a4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-e4d908c2-750e-4a0d-9435-65192d8f64a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=130,cinder:UPDATE=124,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=119,cinder:UPDATE=148,cinder:INSERT=33,cinder:DELETE=5 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-e4d908c2-750e-4a0d-9435-65192d8f64a4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-e4d908c2-750e-4a0d-9435-65192d8f64a4" acquired by "delete_volume" :: waited 0.082s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fb464-ed36-4d64-ad29-cf03af824c20]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 Sep 23 00:25:16 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 1G" returned: 0 in 1.180s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:16 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4" returned: 0 in 0.937s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4 Sep 23 00:25:16 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:17 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.722s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 is being set with open permissions: ugo+rw Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:17 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:17 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e4d908c2-750e-4a0d-9435-65192d8f64a4" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.154s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-e4d908c2-750e-4a0d-9435-65192d8f64a4" released by "delete_volume" :: held 1.518s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aca2f6ce-68ba-4d94-9e5b-5ef45fe19df2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Create snapshot completed successfully Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['492b5b9b-bc84-42fe-812b-fd71da9a0568', 'e5900a30-c233-4287-953c-8227ae963c4e', '3c4e5023-1902-40c3-be2e-b487826ad83b', '140e21a2-6c27-44f8-9520-07c6eef8a323', 'e1b9ee20-41e1-4747-8483-02d9db952893'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:17 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7714aa30-9b9c-4524-b1a5-12c77f3541b4 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-e4d908c2-750e-4a0d-9435-65192d8f64a4-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-dd5c54fb-377a-468a-ae9f-5d2a41be3c78-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-dd5c54fb-377a-468a-ae9f-5d2a41be3c78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22283f01-1b4a-4bba-a4d5-6796d9a4f570]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 Sep 23 00:25:18 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Creating offline snapshot b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0712e0c8-aa03-4c4f-9848-360ee8126e4e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" returned: 0 in 0.672s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78 Sep 23 00:25:19 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:19 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-dd5c54fb-377a-468a-ae9f-5d2a41be3c78" released by "delete_volume" :: held 1.135s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['8b83654b-805c-4b80-a680-d73b5d1cbf36', 'a2205bf4-6c10-4c55-a4f9-3315c4dbb224', '29c7b19e-3fce-4e6b-b649-9945d8f2208a', 'ac8803b7-fde6-435d-b31c-7f4b5566cdab', 'c46e88d1-6c6c-44e4-a30e-4422cafd8cd2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:19 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.631s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 1G Sep 23 00:25:19 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:19 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:20 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.401s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-65205a32-fcbd-4c7f-bf5b-09f72f2f8026 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-dd5c54fb-377a-468a-ae9f-5d2a41be3c78-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:20 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 1G" returned: 0 in 0.708s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:20 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 Sep 23 00:25:20 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-55b019a9-3e57-4b02-ad98-cf0dafd12415-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-55b019a9-3e57-4b02-ad98-cf0dafd12415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-55b019a9-3e57-4b02-ad98-cf0dafd12415" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-55b019a9-3e57-4b02-ad98-cf0dafd12415" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleting offline snapshot 55b019a9-3e57-4b02-ad98-cf0dafd12415 of volume bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] snapshot_file for this snap is: volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0bbaed-5d82-4bd8-9fc8-7432247128fc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:20 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 is being set with open permissions: ugo+rw Sep 23 00:25:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:20 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 Sep 23 00:25:20 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:20 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 Sep 23 00:25:20 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:21 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-beabecd7-9fe6-4557-868a-89f5e3c9bff2 tempest-VolumesSnapshotListTestJSON-1644222813 None] Create snapshot completed successfully Sep 23 00:25:21 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415" returned: 0 in 0.703s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a496f9e-d566-4138-9a43-6233e7098d53]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:21 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 Sep 23 00:25:21 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:22 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380" returned: 0 in 0.659s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:22 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 Sep 23 00:25:22 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:22 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:22 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415 Sep 23 00:25:22 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:23 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380.55b019a9-3e57-4b02-ad98-cf0dafd12415" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-55b019a9-3e57-4b02-ad98-cf0dafd12415" released by "_delete_snapshot" :: held 2.554s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb965ed7-12f3-47eb-a4ca-af5849ea3900 tempest-GroupsTest-1499206340 None] Group tempest-Group1-2104547172: creating Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" released by "delete_snapshot" :: held 2.594s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb965ed7-12f3-47eb-a4ca-af5849ea3900 tempest-GroupsTest-1499206340 None] Group tempest-Group1-2104547172: created successfully Sep 23 00:25:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb965ed7-12f3-47eb-a4ca-af5849ea3900 tempest-GroupsTest-1499206340 None] Create group completed successfully. Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['875d362f-c1d4-4dcc-a267-f2daa4bf8bf5', '7086ca75-2b6b-4a91-b496-30870fddbec7', 'c3f84bca-29cc-4ba5-b20e-1ebcc5b431c9', '2ad59317-04ac-469f-a866-e84d70bde8f5', 'f03adac6-4775-483c-a640-8b557659039c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Delete snapshot completed successfully. Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e63958e1-a9bd-49ed-8f42-9cd1215de7e5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-55b019a9-3e57-4b02-ad98-cf0dafd12415-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-bb88747e-6e5a-4bf7-9a1a-41c1be424380-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-bb88747e-6e5a-4bf7-9a1a-41c1be424380-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Deleting offline snapshot b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] snapshot_file for this snap is: volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e5926-a117-4565-a015-9344ae8e5849]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157d818-efda-4fb1-bb3f-d2926a84ca9c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:24 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 Sep 23 00:25:24 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:24 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 Sep 23 00:25:24 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-58d1cb2a-69f0-4f20-8342-4e4edd961119 tempest-GroupsTest-1499206340 None] Group tempest-Group2-842124794: creating Sep 23 00:25:24 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" returned: 0 in 0.557s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46211c71-8ea8-4dfd-9848-d1d10a46f977]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:24 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-58d1cb2a-69f0-4f20-8342-4e4edd961119 tempest-GroupsTest-1499206340 None] Group tempest-Group2-842124794: created successfully Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380" returned: 0 in 0.569s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-58d1cb2a-69f0-4f20-8342-4e4edd961119 tempest-GroupsTest-1499206340 None] Create group completed successfully. Sep 23 00:25:24 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380 Sep 23 00:25:24 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:24 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:24 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:25 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bb88747e-6e5a-4bf7-9a1a-41c1be424380" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-quobyte-bb88747e-6e5a-4bf7-9a1a-41c1be424380" released by "delete_volume" :: held 1.074s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Created reservations ['d182fb9d-4c7c-4946-8ff5-b61fe8773ff4', 'fc074dc6-a095-41aa-b5b8-0ab3a6a48213', 'c0c82f80-663e-4ce5-b856-df60352ee327', '59399ce2-435f-4c22-adc8-53e1ff59d28e', '99b11dbe-1fdf-47eb-8bd7-9adfc81bbddd'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:25 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.589s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:25 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 Sep 23 00:25:25 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:25 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:25 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:25 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Deleted volume successfully. Sep 23 00:25:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73ca983b-85d4-486a-9182-da15c52963a5 tempest-CreateVolumesFromSnapshotTest-944021278 None] Lock "cinder-bb88747e-6e5a-4bf7-9a1a-41c1be424380-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:26 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" returned: 0 in 0.738s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:26 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54 Sep 23 00:25:26 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:26 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54" released by "_delete_snapshot" :: held 2.491s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" released by "delete_snapshot" :: held 2.552s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (21fb8621-b90d-4c11-916c-d3c53c5be4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6bc55c-553b-469c-a0c9-445cbb34667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6bc55c-553b-469c-a0c9-445cbb34667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-710467497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d502761d-3c81-480c-a321-ef3fdec4695e,host='devstack@QuobyteHD#QuobyteHD',id=049e55ab-5514-4b22-acb2-1fa9b6bc6361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:27Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8faa6a68-c3b1-41a7-ad33-64cb35ee7cb6),volume_type_id=8faa6a68-c3b1-41a7-ad33-64cb35ee7cb6)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1187c556-56b4-4872-b018-12c231c7b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1187c556-56b4-4872-b018-12c231c7b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b3646c-54c5-43f0-8145-0ff435efbb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b3646c-54c5-43f0-8145-0ff435efbb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049e55ab-5514-4b22-acb2-1fa9b6bc6361', 'volume_name': 'volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415220d7-db30-4e69-b570-ca3af2300973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415220d7-db30-4e69-b570-ca3af2300973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736e6996-b30a-4ca4-8f89-177627196253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Volume 049e55ab-5514-4b22-acb2-1fa9b6bc6361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361', 'volume_size': 1} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d502761d-3c81-480c-a321-ef3fdec4695e,created_at=2026-09-22T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-710467497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d502761d-3c81-480c-a321-ef3fdec4695e,host='devstack@QuobyteHD#QuobyteHD',id=049e55ab-5514-4b22-acb2-1fa9b6bc6361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:27Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8faa6a68-c3b1-41a7-ad33-64cb35ee7cb6),volume_type_id=8faa6a68-c3b1-41a7-ad33-64cb35ee7cb6)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Creating volume 049e55ab-5514-4b22-acb2-1fa9b6bc6361 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:26 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Created reservations ['14d1ef38-ad62-485c-8a77-2b6534e94230', '9682081c-7216-4ad4-b7ca-f5301c73a23c', 'e07cffdb-7b8c-49bf-9df1-b126f88875f8', '134891d1-4e8a-4850-aed1-914ba806197e', '1b47b22c-a950-46f1-bc2e-caa3a14498a2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:26 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 1073741824 Sep 23 00:25:26 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Delete snapshot completed successfully. Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fc8493b-d9ed-414d-a6be-39aa0b087178 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-b1f7ea3a-b26d-445a-9ba0-15c03efb7a54-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-d625b5de-f883-4152-89bd-5b584a60e311-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-d625b5de-f883-4152-89bd-5b584a60e311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-d625b5de-f883-4152-89bd-5b584a60e311" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-d625b5de-f883-4152-89bd-5b584a60e311" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Deleting offline snapshot d625b5de-f883-4152-89bd-5b584a60e311 of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] snapshot_file for this snap is: volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e355890-32a8-4eb3-9c96-0e2f631ed463]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:27 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 1073741824" returned: 0 in 0.920s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 Sep 23 00:25:27 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:28 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.813s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed708f-b57d-4385-ae33-548cd4daecb5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:28 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736e6996-b30a-4ca4-8f89-177627196253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab08e2-6b41-4a7e-9ac4-c79e1f4b8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Volume volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 (049e55ab-5514-4b22-acb2-1fa9b6bc6361): created successfully Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab08e2-6b41-4a7e-9ac4-c79e1f4b8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (21fb8621-b90d-4c11-916c-d3c53c5be4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eb7eb2d6-a49f-498a-b28f-31d1584b7ba7 tempest-GroupsTest-1499206340 None] Created volume successfully. Sep 23 00:25:28 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:28 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:28 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.654s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:28 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.674s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:29 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311 Sep 23 00:25:29 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:29 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.d625b5de-f883-4152-89bd-5b584a60e311" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-d625b5de-f883-4152-89bd-5b584a60e311" released by "_delete_snapshot" :: held 2.741s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" released by "delete_snapshot" :: held 2.786s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Created reservations ['547f3c5f-d39c-4ecc-bbf4-401813b4cb5b', '5b82a1b9-cecc-406b-b86c-88948caae94e', '5bafd7b4-258b-4c05-b6e0-cb2577d46751', '2a5c10c4-f0ce-4683-ae1a-3592edb576bc', '17306dc7-2e90-4088-b393-2f152ef1663b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Delete snapshot completed successfully. Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0329081-4484-40f1-ae61-cba5e76c6e66 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-d625b5de-f883-4152-89bd-5b584a60e311-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Acquiring lock "cinder-quobyte-049e55ab-5514-4b22-acb2-1fa9b6bc6361" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-049e55ab-5514-4b22-acb2-1fa9b6bc6361" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab91b18-10da-434e-a6c6-5e71e3e4a4f1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-0771c674-26ea-4c51-acd6-593c8e547d4e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:30 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 Sep 23 00:25:30 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-0771c674-26ea-4c51-acd6-593c8e547d4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-0771c674-26ea-4c51-acd6-593c8e547d4e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-0771c674-26ea-4c51-acd6-593c8e547d4e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Deleting offline snapshot 0771c674-26ea-4c51-acd6-593c8e547d4e of volume 9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] snapshot_file for this snap is: volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[915339f1-cc57-4d3d-af0c-f473dc9cb400]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:30 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361" returned: 0 in 0.568s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:31 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361 Sep 23 00:25:31 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.497s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d099d46-747c-4359-a712-ee2de9a1c96b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:31 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c72b36-6487-45d2-848a-8436d3f1de33]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:31 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-049e55ab-5514-4b22-acb2-1fa9b6bc6361" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-049e55ab-5514-4b22-acb2-1fa9b6bc6361" released by "delete_volume" :: held 1.061s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Created reservations ['5ba68396-1411-416d-bb58-50b2f0775449'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:31 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b Sep 23 00:25:31 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1928604866 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1928604866, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:31 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1928604866 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1928604866, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Created reservations ['be2b34b2-1f0f-46a2-ab7a-5f0d26d939a1', 'deb7558b-b9ba-4e6b-944b-ec61c742e70c', 'f5f39eda-4f92-4558-a18e-1ef15309ee7c', 'ec878426-6fbd-4067-8b5b-7365d54d88de', '377a2225-5aeb-4165-a2d6-3d3c74353135'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:32 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b" returned: 0 in 0.919s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:32 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.708s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:32 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2c07b3d2-d938-4ec7-9b3e-8e6d8873213e tempest-GroupsTest-1499206340 None] Delete group completed successfully. Sep 23 00:25:33 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.963s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e Sep 23 00:25:33 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Created reservations ['64af6999-36b6-4a8b-9082-8ffff0322bbd'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:33 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b.0771c674-26ea-4c51-acd6-593c8e547d4e" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-0771c674-26ea-4c51-acd6-593c8e547d4e" released by "_delete_snapshot" :: held 3.091s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" released by "delete_snapshot" :: held 3.133s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Created reservations ['0c1469d5-3064-4eb4-bcd3-237a6219ccd6', '03e2cc0f-f6ac-4dbc-99c9-fb8611a18b4a', '6f501a34-cf0b-4f77-8cc4-6c0e834f95d4', 'bc2efc18-725c-4858-9efd-a123e6113c02', '563c54a3-a70f-4ba2-a341-ab82cd012835'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:34 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0770ebaa-e51b-4dd9-9243-4b0d451950f5 tempest-GroupsTest-1499206340 None] Delete group completed successfully. Sep 23 00:25:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Delete snapshot completed successfully. Sep 23 00:25:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-49bfde0d-7bb9-47e3-9030-b862eae8e1fe tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-0771c674-26ea-4c51-acd6-593c8e547d4e-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b523f137-a473-4dcd-984e-f70526bfc371 tempest-GroupsTest-1499206340 None] Group tempest-GroupsTest-Group-774571084: creating Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-9d099d46-747c-4359-a712-ee2de9a1c96b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b523f137-a473-4dcd-984e-f70526bfc371 tempest-GroupsTest-1499206340 None] Group tempest-GroupsTest-Group-774571084: created successfully Sep 23 00:25:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b523f137-a473-4dcd-984e-f70526bfc371 tempest-GroupsTest-1499206340 None] Create group completed successfully. Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-9d099d46-747c-4359-a712-ee2de9a1c96b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b33fc9-df5f-4580-80a3-6e63f5d98f05]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b Sep 23 00:25:35 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b Sep 23 00:25:36 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9d099d46-747c-4359-a712-ee2de9a1c96b" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-quobyte-9d099d46-747c-4359-a712-ee2de9a1c96b" released by "delete_volume" :: held 0.982s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Created reservations ['12e83697-152f-458b-a5f7-7d8a1b61652c', '517bd9a7-bf04-4491-a07d-93c2bc3c37b3', 'f12eaf66-3339-4cab-a408-60810e8beecf', 'c9d04e25-1dd5-42d1-b962-2afd384c842b', '6950274e-ee18-409f-984f-e302398cc09e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:36 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Deleted volume successfully. Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-204742ec-0354-4f52-a16f-a66bbffa4f31 tempest-VolumesSnapshotListTestJSON-1644222813 None] Lock "cinder-9d099d46-747c-4359-a712-ee2de9a1c96b-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:37 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:37 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (1f3831a7-52b7-46d0-a32a-abb1c4d3bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121da8a-59c5-42b9-ab9f-a5fecfd7f511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4121da8a-59c5-42b9-ab9f-a5fecfd7f511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-434379878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,host='devstack@QuobyteHD#QuobyteHD',id=8ab6379f-7e5c-42e9-a766-f99f7b685488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:38Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d0c397-44a4-4b0c-8062-f54f877eb10a),volume_type_id=c9d0c397-44a4-4b0c-8062-f54f877eb10a)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba3d697-7021-4054-9b9f-6cbed556511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba3d697-7021-4054-9b9f-6cbed556511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0464b60-596e-4176-a64a-b6dc774c5120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0464b60-596e-4176-a64a-b6dc774c5120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab6379f-7e5c-42e9-a766-f99f7b685488', 'volume_name': 'volume-8ab6379f-7e5c-42e9-a766-f99f7b685488', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae9adc-dcce-44ed-91ad-73174ff9a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae9adc-dcce-44ed-91ad-73174ff9a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eeecf3-75d6-487d-9fcd-5b2dab8e8221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Volume 8ab6379f-7e5c-42e9-a766-f99f7b685488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab6379f-7e5c-42e9-a766-f99f7b685488', 'volume_size': 1} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,created_at=2026-09-22T22:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-434379878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,host='devstack@QuobyteHD#QuobyteHD',id=8ab6379f-7e5c-42e9-a766-f99f7b685488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:38Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d0c397-44a4-4b0c-8062-f54f877eb10a),volume_type_id=c9d0c397-44a4-4b0c-8062-f54f877eb10a)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Creating volume 8ab6379f-7e5c-42e9-a766-f99f7b685488 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:37 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:38 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 1073741824 Sep 23 00:25:38 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 1073741824" returned: 0 in 0.687s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 Sep 23 00:25:38 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:39 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eeecf3-75d6-487d-9fcd-5b2dab8e8221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab6379f-7e5c-42e9-a766-f99f7b685488', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9997792d-0d23-4152-89f1-6e88737f06dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Volume volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 (8ab6379f-7e5c-42e9-a766-f99f7b685488): created successfully Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9997792d-0d23-4152-89f1-6e88737f06dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (1f3831a7-52b7-46d0-a32a-abb1c4d3bde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4051e7bc-5402-43e9-8cd4-685247e14ce4 tempest-GroupsTest-1499206340 None] Created volume successfully. Sep 23 00:25:40 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (41115ab4-0596-474e-a7d7-38e8dba43bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f36436b-116f-4f23-80f3-db1c33157a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f36436b-116f-4f23-80f3-db1c33157a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434135477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,host='devstack@QuobyteHD#QuobyteHD',id=153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:41Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d0c397-44a4-4b0c-8062-f54f877eb10a),volume_type_id=c9d0c397-44a4-4b0c-8062-f54f877eb10a)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb423ca-bff3-4791-9826-f8b2d050a27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb423ca-bff3-4791-9826-f8b2d050a27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1637dca5-66ca-48e7-a3b0-0267648236ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1637dca5-66ca-48e7-a3b0-0267648236ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0', 'volume_name': 'volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a9b38-f289-456d-b0cd-97312ed97b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908a9b38-f289-456d-b0cd-97312ed97b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15eafc-e6a2-4e16-9123-e415695103aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Volume 153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0', 'volume_size': 1} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,created_at=2026-09-22T22:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434135477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65027732-2f44-4bbc-a298-0ae2dfa77cf5,host='devstack@QuobyteHD#QuobyteHD',id=153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d0bcd6069e4e94a0f93ef18e88725c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:41Z,use_quota=True,user_id='c7be1bca398d4e89923cc8a67dbc15b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d0c397-44a4-4b0c-8062-f54f877eb10a),volume_type_id=c9d0c397-44a4-4b0c-8062-f54f877eb10a)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Creating volume 153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:41 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 1073741824 Sep 23 00:25:41 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 1073741824" returned: 0 in 0.605s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 Sep 23 00:25:41 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:42 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15eafc-e6a2-4e16-9123-e415695103aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9db3b2-da25-482d-96fb-a6ecfe345480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Volume volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 (153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0): created successfully Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9db3b2-da25-482d-96fb-a6ecfe345480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Flow 'volume_create_manager' (41115ab4-0596-474e-a7d7-38e8dba43bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dd16f8d2-14dc-4f2a-a12e-1f300d6f470c tempest-GroupsTest-1499206340 None] Created volume successfully. Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (6fd9375c-7115-4c3e-8659-ffe97b288675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d7b811-e455-4875-b606-2548f73b9dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d7b811-e455-4875-b606-2548f73b9dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-183518890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d83228d-791f-4600-8673-c18f25951fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c19215-6dc0-47ee-80c8-8fbd2049c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c19215-6dc0-47ee-80c8-8fbd2049c83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb74ec15-d78f-4b54-9269-2b51f41262d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb74ec15-d78f-4b54-9269-2b51f41262d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d83228d-791f-4600-8673-c18f25951fe3', 'volume_name': 'volume-8d83228d-791f-4600-8673-c18f25951fe3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9760376-85f7-4453-8292-8492b0459181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9760376-85f7-4453-8292-8492b0459181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3406ad84-5774-4fff-a26e-55337234f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume 8d83228d-791f-4600-8673-c18f25951fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d83228d-791f-4600-8673-c18f25951fe3', 'volume_size': 1} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-183518890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d83228d-791f-4600-8673-c18f25951fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:43Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume 8d83228d-791f-4600-8673-c18f25951fe3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:42 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:42 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 1073741824 Sep 23 00:25:42 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 1073741824" returned: 0 in 0.510s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 Sep 23 00:25:43 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f7ff2421-e363-4080-a623-a7b4e4f6cce6 tempest-GroupsTest-1499206340 None] Update group completed successfully. Sep 23 00:25:43 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3406ad84-5774-4fff-a26e-55337234f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d83228d-791f-4600-8673-c18f25951fe3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67fad44-e98b-4b11-9259-142a02174552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-8d83228d-791f-4600-8673-c18f25951fe3 (8d83228d-791f-4600-8673-c18f25951fe3): created successfully Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67fad44-e98b-4b11-9259-142a02174552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (6fd9375c-7115-4c3e-8659-ffe97b288675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c3ce9fb-5f3c-4bfe-9cd3-5ebc8fdc3e6d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d5fd8a0f-8da0-4e05-81d1-abec453ed27f tempest-GroupsTest-1499206340 None] Update group completed successfully. Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (eb8db97a-5a7d-411a-880c-f35c17fee264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d40e3-1318-4d6d-9753-2763aa7b732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284d40e3-1318-4d6d-9753-2763aa7b732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221152332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb13998-9d9d-4f83-9cb9-4775b9fa0a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:45Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09063e9f-be79-4e61-bc23-e6afa4c60714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09063e9f-be79-4e61-bc23-e6afa4c60714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b76a14-6d3a-4663-9207-3f450d661617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b76a14-6d3a-4663-9207-3f450d661617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb13998-9d9d-4f83-9cb9-4775b9fa0a60', 'volume_name': 'volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d69e8e-a919-4650-bd43-c652540039da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d69e8e-a919-4650-bd43-c652540039da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16de8580-1ab0-4493-91c6-0737f7b98cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume 8bb13998-9d9d-4f83-9cb9-4775b9fa0a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60', 'volume_size': 1} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-221152332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb13998-9d9d-4f83-9cb9-4775b9fa0a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:45Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume 8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 1073741824 Sep 23 00:25:45 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (7baf63f3-df0f-405d-a2fc-ebf0cd9991cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06cb255-8198-482b-9433-449f996e56ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06cb255-8198-482b-9433-449f996e56ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1275071294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303b21d6-a284-4481-8bfd-e000bc2dd1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:46Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf93a48-2af1-4162-ba73-22b13d095c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf93a48-2af1-4162-ba73-22b13d095c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ab7be7-0d32-41a7-8ac2-8a2630141fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ab7be7-0d32-41a7-8ac2-8a2630141fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303b21d6-a284-4481-8bfd-e000bc2dd1e8', 'volume_name': 'volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c2d3f2-40c9-4dd6-a4a6-ca83cd612215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c2d3f2-40c9-4dd6-a4a6-ca83cd612215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437cfe4a-0705-4896-b57f-7b9d6af130d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume 303b21d6-a284-4481-8bfd-e000bc2dd1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8', 'volume_size': 1} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 1073741824" returned: 0 in 0.777s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 Sep 23 00:25:46 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (e8d33b4b-0771-4fef-ba19-ea17cd61863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a83ffe2-c078-4b62-a65c-7398b26fdd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a83ffe2-c078-4b62-a65c-7398b26fdd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1624977133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5c467f-38a9-4a82-a0d5-6016931652d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946a0443-2a2c-4095-b2fb-0b99289d8ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946a0443-2a2c-4095-b2fb-0b99289d8ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228200b6-2616-4cd5-8fbb-2f753c0566cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228200b6-2616-4cd5-8fbb-2f753c0566cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5c467f-38a9-4a82-a0d5-6016931652d3', 'volume_name': 'volume-aa5c467f-38a9-4a82-a0d5-6016931652d3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e5e24-f538-4b5b-8e26-4da4ee697275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202e5e24-f538-4b5b-8e26-4da4ee697275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd8b65f-f5b1-4b06-8529-8a3bab705393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume aa5c467f-38a9-4a82-a0d5-6016931652d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5c467f-38a9-4a82-a0d5-6016931652d3', 'volume_size': 1} Sep 23 00:25:47 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1275071294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303b21d6-a284-4481-8bfd-e000bc2dd1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:46Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume 303b21d6-a284-4481-8bfd-e000bc2dd1e8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16de8580-1ab0-4493-91c6-0737f7b98cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fce8af-93e1-4d42-8dd8-10706d7d0da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 1073741824 Sep 23 00:25:47 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 (8bb13998-9d9d-4f83-9cb9-4775b9fa0a60): created successfully Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fce8af-93e1-4d42-8dd8-10706d7d0da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (eb8db97a-5a7d-411a-880c-f35c17fee264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e896a153-1295-4769-a683-1c4984ef0b9e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Acquiring lock "cinder-quobyte-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63868648-3e89-458c-8065-e3e7ab440e73]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:47 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 Sep 23 00:25:47 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (38d07ca7-ca01-410f-9edd-49f5857b7885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af031c1-1020-4595-9932-aa2ed82f28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af031c1-1020-4595-9932-aa2ed82f28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940177512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f872de3c-0562-4d0b-ae90-280011ed39e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e639634-ee5b-4bd6-a3ba-53304a969580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e639634-ee5b-4bd6-a3ba-53304a969580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d93e90-c842-4300-923d-49ba7a508f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d93e90-c842-4300-923d-49ba7a508f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f872de3c-0562-4d0b-ae90-280011ed39e0', 'volume_name': 'volume-f872de3c-0562-4d0b-ae90-280011ed39e0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8486c798-0567-46dc-b57a-d44e6f97a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8486c798-0567-46dc-b57a-d44e6f97a35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa8e88d-baa3-45ca-9420-254fbd04f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume f872de3c-0562-4d0b-ae90-280011ed39e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f872de3c-0562-4d0b-ae90-280011ed39e0', 'volume_size': 1} Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 1073741824" returned: 0 in 0.966s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" returned: 0 in 0.734s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 Sep 23 00:25:48 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0 Sep 23 00:25:48 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (512481b2-b2ec-4912-97d4-716f682a4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:48 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff00382e-094f-42d7-8e23-57daafe887dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1624977133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5c467f-38a9-4a82-a0d5-6016931652d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume aa5c467f-38a9-4a82-a0d5-6016931652d3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff00382e-094f-42d7-8e23-57daafe887dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219232250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1362f833-318b-4f1f-a591-170eda83021a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:48Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146249a-b4c2-446d-90ac-4b4f79798039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 1073741824 Sep 23 00:25:48 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146249a-b4c2-446d-90ac-4b4f79798039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9adc879-eec9-4a7f-a26f-80f81750e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9adc879-eec9-4a7f-a26f-80f81750e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1362f833-318b-4f1f-a591-170eda83021a', 'volume_name': 'volume-1362f833-318b-4f1f-a591-170eda83021a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f619dc-e3ed-4dd3-ae55-db4e6a344524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f619dc-e3ed-4dd3-ae55-db4e6a344524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17670482-ea0a-4839-8a55-b64f609eb782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume 1362f833-318b-4f1f-a591-170eda83021a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1362f833-318b-4f1f-a591-170eda83021a', 'volume_size': 1} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-153ecda2-5ba5-42d8-9cb3-b4284e6ba1f0" released by "delete_volume" :: held 1.378s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Acquiring lock "cinder-quobyte-8ab6379f-7e5c-42e9-a766-f99f7b685488" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437cfe4a-0705-4896-b57f-7b9d6af130d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a455c21d-96b8-4192-8a60-275ba0ef557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-8ab6379f-7e5c-42e9-a766-f99f7b685488" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 (303b21d6-a284-4481-8bfd-e000bc2dd1e8): created successfully Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a455c21d-96b8-4192-8a60-275ba0ef557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (7baf63f3-df0f-405d-a2fc-ebf0cd9991cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa53cf-3b2a-426d-b651-cd3e75b15847]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-37049098-22a5-4109-9a2e-b24b8220372d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:48 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 Sep 23 00:25:48 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 1073741824" returned: 0 in 0.569s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 Sep 23 00:25:49 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488 Sep 23 00:25:49 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:49 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940177512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f872de3c-0562-4d0b-ae90-280011ed39e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:47Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume f872de3c-0562-4d0b-ae90-280011ed39e0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:49 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8ab6379f-7e5c-42e9-a766-f99f7b685488" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 1073741824 Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd8b65f-f5b1-4b06-8529-8a3bab705393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5c467f-38a9-4a82-a0d5-6016931652d3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134898d-b229-4915-9b2d-65227e695905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "cinder-quobyte-8ab6379f-7e5c-42e9-a766-f99f7b685488" released by "delete_volume" :: held 0.911s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 (aa5c467f-38a9-4a82-a0d5-6016931652d3): created successfully Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b134898d-b229-4915-9b2d-65227e695905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (e8d33b4b-0771-4fef-ba19-ea17cd61863d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9ab85b5-9847-4a8f-b9ae-51ce33c3dd0d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Created reservations ['637e5b23-bd5a-4039-9a31-bcb73611fe70'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:49 devstack cinder-volume[86731]: WARNING cinder.quota [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1274557628 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1274557628, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:49 devstack cinder-volume[86731]: WARNING cinder.quota [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1274557628 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1274557628, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:25:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Created reservations ['9c5a68f1-5e2a-4930-b823-986088ff2730', '4fc6d6c9-6109-442d-b20a-db586f78f66c', 'd167486f-1089-4275-abf2-0bf7178feacb', '0f828e0a-e186-4028-8145-76742e680772', 'e1d8668f-a2e1-4cff-9f61-15fe213928a3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Created reservations ['3052e705-1189-4750-a58f-123bd0c2bc6e', 'a7d4eb9d-97c3-4605-8fdc-1f138c57f164', '9a1ce8a8-a1b8-43d0-980d-a6a077e38a8e', '83854f1c-51e6-45f4-b5c9-e777f9c980e7', '7a39a39a-6dc9-49a0-a812-9e5eb5600e24'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:50 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 1073741824" returned: 0 in 0.678s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 Sep 23 00:25:50 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1022da2c-5881-4852-8ea4-66cd05168e13 tempest-GroupsTest-1499206340 None] Delete group completed successfully. Sep 23 00:25:50 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-219232250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1362f833-318b-4f1f-a591-170eda83021a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d7ccd0d234841a8bbb0329b7a4baad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:48Z,use_quota=True,user_id='8dc68c2bf8ba4ee48de3dc38f62d013a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Creating volume 1362f833-318b-4f1f-a591-170eda83021a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a 1073741824 Sep 23 00:25:50 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa8e88d-baa3-45ca-9420-254fbd04f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f872de3c-0562-4d0b-ae90-280011ed39e0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e89c68-7724-4b4a-8c64-f31b6683a350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-f872de3c-0562-4d0b-ae90-280011ed39e0 (f872de3c-0562-4d0b-ae90-280011ed39e0): created successfully Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e89c68-7724-4b4a-8c64-f31b6683a350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (38d07ca7-ca01-410f-9edd-49f5857b7885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f77c4e92-a3a6-4381-b7ba-6c2d272994f6 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:51 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a 1073741824" returned: 0 in 0.541s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a Sep 23 00:25:51 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17670482-ea0a-4839-8a55-b64f609eb782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1362f833-318b-4f1f-a591-170eda83021a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a6fc55-18fc-40e4-8208-f39be644b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Volume volume-1362f833-318b-4f1f-a591-170eda83021a (1362f833-318b-4f1f-a591-170eda83021a): created successfully Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a6fc55-18fc-40e4-8208-f39be644b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Flow 'volume_create_manager' (512481b2-b2ec-4912-97d4-716f682a4efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6829558c-aec9-49a3-911f-71f2a513f778 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created volume successfully. Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-1362f833-318b-4f1f-a591-170eda83021a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-1362f833-318b-4f1f-a591-170eda83021a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-1362f833-318b-4f1f-a591-170eda83021a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-1362f833-318b-4f1f-a591-170eda83021a" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c099eed-60e7-465e-95ff-202cc145b92b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a Sep 23 00:25:52 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:52 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a" returned: 0 in 0.466s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a Sep 23 00:25:52 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1362f833-318b-4f1f-a591-170eda83021a" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-1362f833-318b-4f1f-a591-170eda83021a" released by "delete_volume" :: held 0.850s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['1ec61235-cb17-4ba2-977b-081c7dff9b76', 'a985ae46-a377-4da2-9302-a1e0986cf7cb', '7c388452-a9b6-40c7-844d-ef298adf3140', '1189818f-2f6b-44b7-bf39-1792524f0376', 'd609cddb-5e06-432b-b83c-cfe7878fbc87'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:53 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-f872de3c-0562-4d0b-ae90-280011ed39e0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-f872de3c-0562-4d0b-ae90-280011ed39e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-f872de3c-0562-4d0b-ae90-280011ed39e0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-f872de3c-0562-4d0b-ae90-280011ed39e0" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e0df4-c477-41d6-9d92-ffa35608f55f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:25:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84011d7e-eb25-455c-b143-19afc3fd5c8e tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-1362f833-318b-4f1f-a591-170eda83021a-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:53 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 Sep 23 00:25:53 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0 Sep 23 00:25:54 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f872de3c-0562-4d0b-ae90-280011ed39e0" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-f872de3c-0562-4d0b-ae90-280011ed39e0" released by "delete_volume" :: held 0.958s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['5571bb1e-55bb-4dae-866a-93fe09ba65a7', '134cca8c-5897-4012-86cc-bf493aa67008', 'acac1eae-e79c-49d0-8cef-a96bdde7bb58', '7c9bad9e-64c3-4109-a969-dc6627e01383', '0c922988-de85-45fa-bc62-cb706f7abe21'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:54 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:25:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a068e65-1a9f-4aee-aa45-71071ad51fd4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-f872de3c-0562-4d0b-ae90-280011ed39e0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-aa5c467f-38a9-4a82-a0d5-6016931652d3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-aa5c467f-38a9-4a82-a0d5-6016931652d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-aa5c467f-38a9-4a82-a0d5-6016931652d3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-aa5c467f-38a9-4a82-a0d5-6016931652d3" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62946e3d-798c-46e0-bec8-5416f622bdc2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 Sep 23 00:25:55 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3" returned: 0 in 0.567s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3 Sep 23 00:25:56 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-aa5c467f-38a9-4a82-a0d5-6016931652d3" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-aa5c467f-38a9-4a82-a0d5-6016931652d3" released by "delete_volume" :: held 0.981s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['203b657a-5fcc-4d1a-9a1b-11f9fe5b5e7c', '2840400c-b74a-4d67-a90d-54c95b08965e', '6b06fdb6-7c05-4b12-8102-d1bb324c9245', '43b8af5e-6550-46bf-b071-ef5d50a8ffe6', 'eed8f6ac-050e-47e7-91c4-f20019c8f0a0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:57 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:25:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2784b716-377f-48e7-a962-929364e6eaf4 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-aa5c467f-38a9-4a82-a0d5-6016931652d3-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-303b21d6-a284-4481-8bfd-e000bc2dd1e8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-303b21d6-a284-4481-8bfd-e000bc2dd1e8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-303b21d6-a284-4481-8bfd-e000bc2dd1e8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-303b21d6-a284-4481-8bfd-e000bc2dd1e8" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3eff03-1852-41b7-a8f8-c0372071422f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 Sep 23 00:25:58 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8" returned: 0 in 0.440s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:58 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8 Sep 23 00:25:58 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d546d1a3-4906-4f16-b202-220f31adba59 tempest-GroupsV314Test-486634380 None] Group tempest-GroupsV314Test-Group-2037001458: creating Sep 23 00:25:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d546d1a3-4906-4f16-b202-220f31adba59 tempest-GroupsV314Test-486634380 None] Group tempest-GroupsV314Test-Group-2037001458: created successfully Sep 23 00:25:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d546d1a3-4906-4f16-b202-220f31adba59 tempest-GroupsV314Test-486634380 None] Create group completed successfully. Sep 23 00:25:58 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-303b21d6-a284-4481-8bfd-e000bc2dd1e8" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-303b21d6-a284-4481-8bfd-e000bc2dd1e8" released by "delete_volume" :: held 0.771s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['d7beabf2-cd92-4c29-becb-42285d1f14a0', '9e1fabaa-df7a-4e80-94ab-97d1aa103b74', '3491c142-0fca-4036-8f18-8bb8cd95778c', 'f8cb91bf-0e4c-4d06-8f38-d34c1eea2c2f', '3bc0f4b0-e8c9-4bf1-b0be-b196b0c27c9e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:25:59 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[57449e4f-12bc-4edf-ac74-717f27837649]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd6786fb-f54f-46f9-86fa-e275d98de74f tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-303b21d6-a284-4481-8bfd-e000bc2dd1e8-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:59 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 Sep 23 00:25:59 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60 Sep 23 00:25:59 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (208ccdb4-92a0-4192-ae88-09733e282646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962300f-6cfc-44b7-99f4-e06372ca8c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5962300f-6cfc-44b7-99f4-e06372ca8c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-522162397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f6793a-0c48-4620-84e3-916fcece36b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:00Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7739ed89-4b83-43ba-97f3-3c4685501a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7739ed89-4b83-43ba-97f3-3c4685501a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025984f7-613b-43e8-a58e-cd13dd77ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025984f7-613b-43e8-a58e-cd13dd77ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f6793a-0c48-4620-84e3-916fcece36b6', 'volume_name': 'volume-32f6793a-0c48-4620-84e3-916fcece36b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d77740-efb9-4ef3-aa51-6df4a5b91ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d77740-efb9-4ef3-aa51-6df4a5b91ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a43134-db09-4d2f-9f1e-bcaca895c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Volume 32f6793a-0c48-4620-84e3-916fcece36b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f6793a-0c48-4620-84e3-916fcece36b6', 'volume_size': 1} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-522162397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f6793a-0c48-4620-84e3-916fcece36b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:00Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Creating volume 32f6793a-0c48-4620-84e3-916fcece36b6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:00 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 1073741824 Sep 23 00:26:00 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60" released by "delete_volume" :: held 0.870s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['8d7ecf38-f714-42ec-8c03-9c781a06094f', '49cf5e77-433e-4b35-81b5-32da43422071', '88fef1f3-dd55-4bdb-add6-82ebf74ae692', '698f52c5-15e3-434a-a1c0-c69dd6e058d6', 'ee4e19cb-13e3-4d54-9551-ed6e0b7bad00'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:00 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-8d83228d-791f-4600-8673-c18f25951fe3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-8d83228d-791f-4600-8673-c18f25951fe3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "cinder-quobyte-8d83228d-791f-4600-8673-c18f25951fe3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-8d83228d-791f-4600-8673-c18f25951fe3" acquired by "delete_volume" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcdad55-caae-4ff3-b840-b38910af3729]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Flow 'volume_create_manager' (a243b872-4318-44e4-badb-a4828a56e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa55c746-db69-43a2-81c7-e7e6ca4ae106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa55c746-db69-43a2-81c7-e7e6ca4ae106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1819050647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=948d8ee9-0386-4a1d-9b2c-b0815bd171d3,host='devstack@QuobyteHD#QuobyteHD',id=b402452a-5caa-42c8-9956-37c8e811dad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2addaaec7ecb40b0bfd13197b7b1fbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:01Z,use_quota=True,user_id='1666730aa6de4f22a0ed94fc89085992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fef6f422-02bc-4b01-9cbf-1c633cdd870f),volume_type_id=fef6f422-02bc-4b01-9cbf-1c633cdd870f)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e223ba-7394-4643-b162-28a34ab7d79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e223ba-7394-4643-b162-28a34ab7d79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfbf669-9184-4c8b-b4b3-6e8d742b4c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dfbf669-9184-4c8b-b4b3-6e8d742b4c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b402452a-5caa-42c8-9956-37c8e811dad9', 'volume_name': 'volume-b402452a-5caa-42c8-9956-37c8e811dad9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4249220f-b896-4969-96e9-12518a37871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4249220f-b896-4969-96e9-12518a37871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa881cce-8251-414f-a0f7-39c788cc69e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Volume b402452a-5caa-42c8-9956-37c8e811dad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b402452a-5caa-42c8-9956-37c8e811dad9', 'volume_size': 1} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 1073741824" returned: 0 in 0.824s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.464s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:00 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 Sep 23 00:26:00 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7c5c740-eca5-4a0f-bea5-e6db1269a426 tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-8bb13998-9d9d-4f83-9cb9-4775b9fa0a60-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:00 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 Sep 23 00:26:00 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:01 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=948d8ee9-0386-4a1d-9b2c-b0815bd171d3,created_at=2026-09-22T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1819050647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=948d8ee9-0386-4a1d-9b2c-b0815bd171d3,host='devstack@QuobyteHD#QuobyteHD',id=b402452a-5caa-42c8-9956-37c8e811dad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2addaaec7ecb40b0bfd13197b7b1fbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:01Z,use_quota=True,user_id='1666730aa6de4f22a0ed94fc89085992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fef6f422-02bc-4b01-9cbf-1c633cdd870f),volume_type_id=fef6f422-02bc-4b01-9cbf-1c633cdd870f)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Creating volume b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:01 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:01 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:01 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 1073741824 Sep 23 00:26:01 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a43134-db09-4d2f-9f1e-bcaca895c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f6793a-0c48-4620-84e3-916fcece36b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e6924d-ac72-47e9-887b-2ebd6f9d90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:01 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3 Sep 23 00:26:01 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Volume volume-32f6793a-0c48-4620-84e3-916fcece36b6 (32f6793a-0c48-4620-84e3-916fcece36b6): created successfully Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e6924d-ac72-47e9-887b-2ebd6f9d90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (208ccdb4-92a0-4192-ae88-09733e282646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4647002f-5686-4789-9c6d-1c9bc45962d7 tempest-AttachVolumeNegativeTest-279379255 None] Created volume successfully. Sep 23 00:26:01 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-8d83228d-791f-4600-8673-c18f25951fe3" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-quobyte-8d83228d-791f-4600-8673-c18f25951fe3" released by "delete_volume" :: held 0.873s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Created reservations ['383237c5-b56f-477e-bcc9-f9bc4869f155', '02d6c78c-7db8-4597-8df3-7e5ddca0f5b8', 'd3be2c75-923b-471a-b28a-5b88395bb6cf', '60dc7503-e651-42cd-a1e9-4ece97e37022', 'f2a4c9da-4b86-4d80-87fe-c12723bc2c44'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:01 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 1073741824" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:01 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:01 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:01 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:01 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:02 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Deleted volume successfully. Sep 23 00:26:02 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7bbf81b8-ceca-459e-9408-84ce11195c8d tempest-CreateVolumesFromSourceVolumeTest-1225980817 None] Lock "cinder-8d83228d-791f-4600-8673-c18f25951fe3-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa881cce-8251-414f-a0f7-39c788cc69e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b402452a-5caa-42c8-9956-37c8e811dad9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d83c6d2-b395-4afa-ac74-d02ed34e8a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Volume volume-b402452a-5caa-42c8-9956-37c8e811dad9 (b402452a-5caa-42c8-9956-37c8e811dad9): created successfully Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d83c6d2-b395-4afa-ac74-d02ed34e8a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Flow 'volume_create_manager' (a243b872-4318-44e4-badb-a4828a56e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d777dfe5-9c55-43ed-94d4-68ba7b591956 tempest-GroupsV314Test-486634380 None] Created volume successfully. Sep 23 00:26:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-22ea16d4-9e5d-45ea-aa4f-21dcf56c3edc req-d4988717-4859-4e99-b430-740f7b3da542 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-22ea16d4-9e5d-45ea-aa4f-21dcf56c3edc req-d4988717-4859-4e99-b430-740f7b3da542 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-22ea16d4-9e5d-45ea-aa4f-21dcf56c3edc req-d4988717-4859-4e99-b430-740f7b3da542 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.077s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-22ea16d4-9e5d-45ea-aa4f-21dcf56c3edc req-d4988717-4859-4e99-b430-740f7b3da542 tempest-AttachVolumeNegativeTest-279379255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-32f6793a-0c48-4620-84e3-916fcece36b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24be6f6e-8de2-4be7-8771-d2117d55c1be', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-22ea16d4-9e5d-45ea-aa4f-21dcf56c3edc req-d4988717-4859-4e99-b430-740f7b3da542 tempest-AttachVolumeNegativeTest-279379255 None] attachment_update completed successfully. Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Cloning volume b402452a-5caa-42c8-9956-37c8e811dad9 to volume 63ae43d3-a8da-40cb-9864-2eabcf6e2f5f Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Creating offline snapshot b1359abb-ed57-42b3-994e-68d60f467f0f of volume b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66509277-cc6e-4751-8acc-bf06407921b3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:04 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:04 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f 1G Sep 23 00:26:05 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:05 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f 1G" returned: 0 in 0.596s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402452a-5caa-42c8-9956-37c8e811dad9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402452a-5caa-42c8-9956-37c8e811dad9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:05 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:06 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b402452a-5caa-42c8-9956-37c8e811dad9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:06 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:06 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-6192a8bb-9130-40c3-b921-cd180402f0ac req-15b2db05-b54e-410c-bfc9-f81eb3eb2c2d tempest-AttachVolumeNegativeTest-279379255 None] Terminate volume connection completed successfully. Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-6192a8bb-9130-40c3-b921-cd180402f0ac req-15b2db05-b54e-410c-bfc9-f81eb3eb2c2d tempest-AttachVolumeNegativeTest-279379255 None] Deleting attachment 24be6f6e-8de2-4be7-8771-d2117d55c1be. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Flow 'volume_create_manager' (e4bbb7a1-a7f8-4efa-95e4-009676053139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d76f69-d53e-41b1-b24c-024cdbc1726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d76f69-d53e-41b1-b24c-024cdbc1726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1930521560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1447be00-e447-4cb3-91b3-2389f5878ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16e8b4dc12f45e7963a1ca1d27c2661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:06Z,use_quota=True,user_id='01fa38394fe74c37a5f797560e2fce6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b3f428-66cc-4183-84ab-72fd439050a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b3f428-66cc-4183-84ab-72fd439050a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979adb80-c1dd-4773-986e-3a574cb5d384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979adb80-c1dd-4773-986e-3a574cb5d384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1447be00-e447-4cb3-91b3-2389f5878ffd', 'volume_name': 'volume-1447be00-e447-4cb3-91b3-2389f5878ffd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21e6f08-1b46-44e4-9712-a9303afe9815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21e6f08-1b46-44e4-9712-a9303afe9815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0fbbf8-a48d-4253-9569-9ea1d7447f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Volume 1447be00-e447-4cb3-91b3-2389f5878ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1447be00-e447-4cb3-91b3-2389f5878ffd', 'volume_size': 1} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:06 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.349s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:06 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info Sep 23 00:26:06 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:06 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:06 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info Sep 23 00:26:06 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:07 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.info" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Acquiring lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] snapshot: b1359abb-ed57-42b3-994e-68d60f467f0f, volume: 63ae43d3-a8da-40cb-9864-2eabcf6e2f5f, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf34a62-c62d-460e-a61d-bc428a3aa41b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:07 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:07 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:07 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.619s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b402452a-5caa-42c8-9956-37c8e811dad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbbef7f-18e6-4452-8a26-35863c716002]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:07 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:07 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:08 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.511s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:08 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:08 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f Sep 23 00:26:08 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" returned: 0 in 7.970s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:16 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Converted 1024.00 MB image at 128.47 MB/s Sep 23 00:26:16 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f Sep 23 00:26:16 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=171,cinder:UPDATE=191,cinder:INSERT=51,cinder:DELETE=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=156,cinder:DELETE=17,cinder:INSERT=50,cinder:UPDATE=196 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:16 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" released by "_copy_volume_from_snapshot" :: held 9.525s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Acquiring lock "cinder-quobyte-b1359abb-ed57-42b3-994e-68d60f467f0f" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-b1359abb-ed57-42b3-994e-68d60f467f0f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Deleting offline snapshot b1359abb-ed57-42b3-994e-68d60f467f0f of volume b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] snapshot_file for this snap is: volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad7a8a-06dc-4576-847f-14f1eb854145]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:16 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b402452a-5caa-42c8-9956-37c8e811dad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af71cf9-0b52-4a91-b405-ea2a1947fe07]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:17 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.671s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:17 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f Sep 23 00:26:18 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9.b1359abb-ed57-42b3-994e-68d60f467f0f" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-b1359abb-ed57-42b3-994e-68d60f467f0f" released by "_delete_snapshot" :: held 2.098s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.401s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.450s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1930521560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1447be00-e447-4cb3-91b3-2389f5878ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16e8b4dc12f45e7963a1ca1d27c2661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:06Z,use_quota=True,user_id='01fa38394fe74c37a5f797560e2fce6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Creating volume 1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd 1073741824 Sep 23 00:26:18 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7de410f7-cce5-4f0b-b5f2-90b615b9d915 tempest-GroupsV314Test-486634380 None] Create group from source-group-948d8ee9-0386-4a1d-9b2c-b0815bd171d3 completed successfully. Sep 23 00:26:19 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd 1073741824" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:19 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:19 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0fbbf8-a48d-4253-9569-9ea1d7447f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1447be00-e447-4cb3-91b3-2389f5878ffd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9178f8ff-d972-47ae-8de5-2aa0e1cc92fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Volume volume-1447be00-e447-4cb3-91b3-2389f5878ffd (1447be00-e447-4cb3-91b3-2389f5878ffd): created successfully Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9178f8ff-d972-47ae-8de5-2aa0e1cc92fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Flow 'volume_create_manager' (e4bbb7a1-a7f8-4efa-95e4-009676053139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9c8e72d6-ef54-404f-bb68-3b51356dc114 tempest-VolumeDependencyTests-1052261315 None] Created volume successfully. Sep 23 00:26:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Acquiring lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf39df-946c-493c-b747-4c79eddc7990]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:20 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f Sep 23 00:26:20 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Creating offline snapshot aa97f774-fc1a-4661-9c13-844ef7c02090 of volume 1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada23221-c4e6-4bfa-9d27-c999d9a36402]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" returned: 0 in 0.712s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f Sep 23 00:26:21 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:21 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-63ae43d3-a8da-40cb-9864-2eabcf6e2f5f" released by "delete_volume" :: held 1.129s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Created reservations ['5a1c01a5-4ab9-4311-af06-006737816c77'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:21 devstack cinder-volume[86731]: WARNING cinder.quota [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1725189709 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1725189709, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:21 devstack cinder-volume[86731]: WARNING cinder.quota [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1725189709 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1725189709, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:26:21 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.604s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 1G Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Created reservations ['d7ec6d48-c110-4e92-bc96-b7493d540547', 'e5102675-d061-412b-a52c-58aa702f2c91', 'dea182e7-5831-46f8-98f0-f3d090ca67d5', '8aec94ec-6c71-49ab-af9d-e7cfbcbf51e6', '7c279a5d-6dda-4a2e-a855-b7c69cdecfe7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:21 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:21 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:22 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 1G" returned: 0 in 0.603s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1447be00-e447-4cb3-91b3-2389f5878ffd -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:22 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:22 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1447be00-e447-4cb3-91b3-2389f5878ffd -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:22 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df49f7b6-941a-4d8b-8f15-96d6e798686f tempest-GroupsV314Test-486634380 None] Delete group completed successfully. Sep 23 00:26:22 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1447be00-e447-4cb3-91b3-2389f5878ffd -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:22 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 is being set with open permissions: ugo+rw Sep 23 00:26:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:22 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:22 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:22 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info Sep 23 00:26:23 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Acquiring lock "cinder-quobyte-b402452a-5caa-42c8-9956-37c8e811dad9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-b402452a-5caa-42c8-9956-37c8e811dad9" acquired by "delete_volume" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:23 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info" returned: 0 in 0.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:23 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info is being set with open permissions: ugo+rw Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e1683-e971-4f59-85f0-02c48945e378]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:23 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info Sep 23 00:26:23 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:23 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:23 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.info" returned: 0 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-403cb0b7-10b8-4c27-bee9-675cd1ae2594 tempest-VolumeDependencyTests-1052261315 None] Create snapshot completed successfully Sep 23 00:26:24 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.751s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:24 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9 Sep 23 00:26:24 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:24 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b402452a-5caa-42c8-9956-37c8e811dad9" returned: 0 in 0.507s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Lock "cinder-quobyte-b402452a-5caa-42c8-9956-37c8e811dad9" released by "delete_volume" :: held 1.488s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Created reservations ['90cf9b14-cca1-4104-9a3d-36e9aa664fd4'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Created reservations ['1675ec3f-1ad6-4e14-a67d-f56d939e4ba0', '920ee992-111e-449d-b024-2a638100af69', '5cb97764-768c-4256-b5f4-b2f7a96bad22', '0dfd68ef-b570-475a-bc27-68582228324b', '6ec62184-22e5-48f3-801b-1421c318f44d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:25 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:25 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:25 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-33d30a7c-0567-4f97-af37-4d07e7aad636 tempest-GroupsV314Test-486634380 None] Delete group completed successfully. Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Flow 'volume_create_manager' (33da01ad-8817-4851-9ec8-a04d9059d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288fe697-bb9d-439c-b9a3-c90622e7fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288fe697-bb9d-439c-b9a3-c90622e7fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1782181720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f50c84b-5c9f-420d-afe2-6808b49b040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16e8b4dc12f45e7963a1ca1d27c2661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa97f774-fc1a-4661-9c13-844ef7c02090,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:26Z,use_quota=True,user_id='01fa38394fe74c37a5f797560e2fce6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b23556d-8738-45fe-bebe-89f6af86d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b23556d-8738-45fe-bebe-89f6af86d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe26d510-caa2-498b-b1f7-e6de7b21f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe26d510-caa2-498b-b1f7-e6de7b21f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f50c84b-5c9f-420d-afe2-6808b49b040c', 'volume_name': 'volume-3f50c84b-5c9f-420d-afe2-6808b49b040c', 'volume_size': 1, 'snapshot_id': 'aa97f774-fc1a-4661-9c13-844ef7c02090'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ac564c-0adc-4090-827b-010c43e8f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ac564c-0adc-4090-827b-010c43e8f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756a33d9-7ee7-4bb3-be9a-5e7a8e923a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Volume 3f50c84b-5c9f-420d-afe2-6808b49b040c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f50c84b-5c9f-420d-afe2-6808b49b040c', 'volume_size': 1, 'snapshot_id': 'aa97f774-fc1a-4661-9c13-844ef7c02090'} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090-3f50c84b-5c9f-420d-afe2-6808b49b040c" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090-3f50c84b-5c9f-420d-afe2-6808b49b040c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Creating volume 3f50c84b-5c9f-420d-afe2-6808b49b040c from snapshot aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] snapshot: aa97f774-fc1a-4661-9c13-844ef7c02090, volume: 3f50c84b-5c9f-420d-afe2-6808b49b040c, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae22a5-777e-4830-b5bd-576602d40f23]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:26 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:26 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:27 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.815s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1447be00-e447-4cb3-91b3-2389f5878ffd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31b38a-a319-4293-9182-b6ddd2a49d81]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:27 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:27 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:27 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.594s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:28 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c Sep 23 00:26:28 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=34,cinder:SELECT=23,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:36 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=28,cinder:SELECT=30,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:37 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c" returned: 0 in 9.674s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:37 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Converted 1024.00 MB image at 105.83 MB/s Sep 23 00:26:37 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c is being set with open permissions: ugo+rw Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c Sep 23 00:26:37 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:37 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" released by "_copy_volume_from_snapshot" :: held 11.570s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090-3f50c84b-5c9f-420d-afe2-6808b49b040c" released by "_create_volume_from_snapshot" :: held 11.676s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.699s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756a33d9-7ee7-4bb3-be9a-5e7a8e923a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f50c84b-5c9f-420d-afe2-6808b49b040c', 'volume_size': 1, 'snapshot_id': 'aa97f774-fc1a-4661-9c13-844ef7c02090'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588d0cf7-2996-4be4-aad2-f7269e0d128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:38 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Volume volume-3f50c84b-5c9f-420d-afe2-6808b49b040c (3f50c84b-5c9f-420d-afe2-6808b49b040c): created successfully Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (588d0cf7-2996-4be4-aad2-f7269e0d128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Flow 'volume_create_manager' (33da01ad-8817-4851-9ec8-a04d9059d51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4484d3fc-7f36-4297-965d-5d3586f95efe tempest-VolumeDependencyTests-1052261315 None] Created volume successfully. Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-aa97f774-fc1a-4661-9c13-844ef7c02090-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-aa97f774-fc1a-4661-9c13-844ef7c02090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Deleting offline snapshot aa97f774-fc1a-4661-9c13-844ef7c02090 of volume 1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] snapshot_file for this snap is: volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b164d5e5-0fdf-4b4b-94ab-d47e7df43366]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:39 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:39 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:39 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1447be00-e447-4cb3-91b3-2389f5878ffd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa304d2-60cb-475e-b071-ceae7bfd2f82]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:39 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:39 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.710s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:40 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090 Sep 23 00:26:40 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd.aa97f774-fc1a-4661-9c13-844ef7c02090" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-aa97f774-fc1a-4661-9c13-844ef7c02090" released by "_delete_snapshot" :: held 2.167s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" released by "delete_snapshot" :: held 2.204s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:41 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Created reservations ['70225684-ba6f-4828-a26a-693b0767741f', '931e0613-aa4f-4bb4-a3f4-62a0129f0b7c', 'be0b74bf-a90b-4e2b-9a29-56b521dd81f6', '0f6cde4b-062e-4aff-8f74-60f9e9934cd2', '155dc71b-bd86-4580-8a28-967bc8d4a638'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Delete snapshot completed successfully. Sep 23 00:26:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-641936b1-6913-48b5-91c3-3f9a459a051c tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-aa97f774-fc1a-4661-9c13-844ef7c02090-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-1447be00-e447-4cb3-91b3-2389f5878ffd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-1447be00-e447-4cb3-91b3-2389f5878ffd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c0125-fb51-4921-97bd-07547430d164]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:42 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd Sep 23 00:26:42 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:43 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1447be00-e447-4cb3-91b3-2389f5878ffd" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-1447be00-e447-4cb3-91b3-2389f5878ffd" released by "delete_volume" :: held 0.841s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Created reservations ['279e13fe-b3de-4f61-aa86-03c6ba91568c', 'b5164cd5-2f70-44d7-9c75-edef6b15d51d', 'd2582574-3adb-40d8-9bd6-b8afcb38b02e', 'c10bf07f-5a15-46fb-8ac7-b938f58d7a5c', '72b450fb-9bf6-46d2-9c86-d920321fe17c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:43 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:43 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-3f50c84b-5c9f-420d-afe2-6808b49b040c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-3f50c84b-5c9f-420d-afe2-6808b49b040c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c047b-6048-442e-9fc3-3c92b7328e46]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:43 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Deleted volume successfully. Sep 23 00:26:43 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c Sep 23 00:26:43 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d8bff2b-75c9-49a9-b2eb-bcdcd9e21679 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-1447be00-e447-4cb3-91b3-2389f5878ffd-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:44 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:44 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c Sep 23 00:26:44 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:44 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3f50c84b-5c9f-420d-afe2-6808b49b040c" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-quobyte-3f50c84b-5c9f-420d-afe2-6808b49b040c" released by "delete_volume" :: held 0.936s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Created reservations ['9b13fb64-866d-4c2d-8e33-f0d3af2b4090', '8f9a9a1e-9e39-435f-b13d-dc557e1cf271', '59b35af2-2a34-445f-93c0-a420635a05e4', '00c12fb1-f61c-42ca-8c9d-f4ea222dd8a9', '6375d506-0431-4861-b899-770d69c6aa30'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:44 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:26:44 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:44 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:44 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Deleted volume successfully. Sep 23 00:26:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3e71b6ac-b6cc-4cc1-988c-5e2f77d174c3 tempest-VolumeDependencyTests-1052261315 None] Lock "cinder-3f50c84b-5c9f-420d-afe2-6808b49b040c-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Flow 'volume_create_manager' (dcb7b060-feac-4bed-b3a6-0a486149a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b169af-30bf-4fff-97d4-7bb610939c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b169af-30bf-4fff-97d4-7bb610939c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-940252291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b79bd4-b5b7-4ef5-a403-1cf47666a19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17285615e86549199ec793ad25a89b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:49Z,use_quota=True,user_id='7ff3278bd95740098c844d08ed626c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030da5f9-20f6-4cc9-be1e-cf42fdcea4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030da5f9-20f6-4cc9-be1e-cf42fdcea4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173a7ffb-2faf-4d4c-aa07-e27f83fced39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (173a7ffb-2faf-4d4c-aa07-e27f83fced39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b79bd4-b5b7-4ef5-a403-1cf47666a19f', 'volume_name': 'volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999ee739-87d9-4ac9-b874-9ea46747c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999ee739-87d9-4ac9-b874-9ea46747c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57baeaf2-ee62-4c93-9caf-7202bec12178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Volume 22b79bd4-b5b7-4ef5-a403-1cf47666a19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f', 'volume_size': 1} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-940252291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b79bd4-b5b7-4ef5-a403-1cf47666a19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17285615e86549199ec793ad25a89b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:49Z,use_quota=True,user_id='7ff3278bd95740098c844d08ed626c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Creating volume 22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:49 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:49 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f 1073741824 Sep 23 00:26:49 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Flow 'volume_create_manager' (924b0023-6277-40ad-ab9a-2fb0051b45f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fab2c3a-5167-4fd5-bfb8-b53e40612bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fab2c3a-5167-4fd5-bfb8-b53e40612bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16cbdd-f7f6-4635-bee2-eb137ad82559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eccc6c7c8a7640dcba18fd3837b161a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:50Z,use_quota=True,user_id='52a22fb6138e439898da5a0a9e909ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69457063-af39-4468-a6bb-4b66a5d5ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69457063-af39-4468-a6bb-4b66a5d5ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d10b7e7-e15a-442f-8556-2a53a3f2e97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d10b7e7-e15a-442f-8556-2a53a3f2e97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b16cbdd-f7f6-4635-bee2-eb137ad82559', 'volume_name': 'volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67debc86-4982-4238-a161-64348b2e9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67debc86-4982-4238-a161-64348b2e9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dc5a16-aa97-48a1-a47c-17926725ad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Volume 3b16cbdd-f7f6-4635-bee2-eb137ad82559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559', 'volume_size': 1} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:50 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (5a897147-7823-4dd0-99dd-f8af652d5d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11672840-5e6f-4a55-bf9f-2419cf7035e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f 1073741824" returned: 0 in 0.722s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11672840-5e6f-4a55-bf9f-2419cf7035e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1803124310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae552ad-d117-4a16-bc28-d81ee1f80f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:50Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b6f5f7-22e4-44f8-87c0-5afdc9ab2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b6f5f7-22e4-44f8-87c0-5afdc9ab2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4735604d-605c-42bb-8774-0eec99dfcf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4735604d-605c-42bb-8774-0eec99dfcf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae552ad-d117-4a16-bc28-d81ee1f80f5b', 'volume_name': 'volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185ae505-94ab-490d-a803-2e4231a48ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185ae505-94ab-490d-a803-2e4231a48ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f650a0-3588-464c-9676-37eeb9df0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Volume 6ae552ad-d117-4a16-bc28-d81ee1f80f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b', 'volume_size': 1} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:50 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f Sep 23 00:26:50 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:50 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16cbdd-f7f6-4635-bee2-eb137ad82559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eccc6c7c8a7640dcba18fd3837b161a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:50Z,use_quota=True,user_id='52a22fb6138e439898da5a0a9e909ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Creating volume 3b16cbdd-f7f6-4635-bee2-eb137ad82559 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57baeaf2-ee62-4c93-9caf-7202bec12178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d62bce3-8adc-439d-8d46-32599c701ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:50 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 1073741824 Sep 23 00:26:50 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Volume volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f (22b79bd4-b5b7-4ef5-a403-1cf47666a19f): created successfully Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d62bce3-8adc-439d-8d46-32599c701ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Flow 'volume_create_manager' (dcb7b060-feac-4bed-b3a6-0a486149a695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-80d4b080-7509-40ac-8d0c-c63c4d6e2a1b tempest-SnapshotMetadataTestJSON-1785273519 None] Created volume successfully. Sep 23 00:26:51 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 1073741824" returned: 0 in 0.506s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 Sep 23 00:26:51 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1803124310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae552ad-d117-4a16-bc28-d81ee1f80f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a8f8829f50471db2498ac0a60f6b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:50Z,use_quota=True,user_id='f17b28689d22471e89cb80a44d1b1d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Creating volume 6ae552ad-d117-4a16-bc28-d81ee1f80f5b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dc5a16-aa97-48a1-a47c-17926725ad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b 1073741824 Sep 23 00:26:51 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02c43ed-f7a9-4f6f-8e2f-83c7b4decd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Volume volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 (3b16cbdd-f7f6-4635-bee2-eb137ad82559): created successfully Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02c43ed-f7a9-4f6f-8e2f-83c7b4decd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Flow 'volume_create_manager' (924b0023-6277-40ad-ab9a-2fb0051b45f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-19019e84-1f2e-43a9-ad56-2983d637fe99 tempest-CinderUnicodeTest-7422869 None] Created volume successfully. Sep 23 00:26:52 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b 1073741824" returned: 0 in 0.579s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b Sep 23 00:26:52 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.841s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f650a0-3588-464c-9676-37eeb9df0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49cd2b9-05e2-4927-942c-b63c0e24a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Creating offline snapshot 113d2fd2-052a-42fb-a882-785a5b642299 of volume 22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Volume volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b (6ae552ad-d117-4a16-bc28-d81ee1f80f5b): created successfully Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49cd2b9-05e2-4927-942c-b63c0e24a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Flow 'volume_create_manager' (5a897147-7823-4dd0-99dd-f8af652d5d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b6259-8065-4afd-a532-3e6a894173ed]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c10a51f7-571d-4b41-ace9-c277e3e7b942 tempest-AttachVolumeNegativeTest-279379255 None] Created volume successfully. Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Flow 'volume_create_manager' (fa5244e2-9b8e-4dca-8575-09fbe302568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e0ab59-e622-4169-b909-20d4a0dc292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f Sep 23 00:26:52 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e0ab59-e622-4169-b909-20d4a0dc292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-867056951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec26278-c45b-466f-b592-9772c0d8a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eccc6c7c8a7640dcba18fd3837b161a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:53Z,use_quota=True,user_id='52a22fb6138e439898da5a0a9e909ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf8c96d-1cc0-4594-b310-152c3efd5eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf8c96d-1cc0-4594-b310-152c3efd5eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be955f2c-2f09-4900-9a6c-e12cc1782377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be955f2c-2f09-4900-9a6c-e12cc1782377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec26278-c45b-466f-b592-9772c0d8a78b', 'volume_name': 'volume-2ec26278-c45b-466f-b592-9772c0d8a78b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e1a777-555c-4318-b50f-21d5e10b7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e1a777-555c-4318-b50f-21d5e10b7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafdd82-3fd7-44c4-8e68-d413e8fbb655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Volume 2ec26278-c45b-466f-b592-9772c0d8a78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec26278-c45b-466f-b592-9772c0d8a78b', 'volume_size': 1} Sep 23 00:26:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:53 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 1G Sep 23 00:26:53 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:53 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 1G" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 Sep 23 00:26:53 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 is being set with open permissions: ugo+rw Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 Sep 23 00:26:54 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info Sep 23 00:26:54 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-518f51cb-d12b-47a6-91ae-588d07ca99a7 req-9ae4a810-8887-48df-97b6-29b32c8b4ba0 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info is being set with open permissions: ugo+rw Sep 23 00:26:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info Sep 23 00:26:54 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.info" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-867056951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec26278-c45b-466f-b592-9772c0d8a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eccc6c7c8a7640dcba18fd3837b161a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:53Z,use_quota=True,user_id='52a22fb6138e439898da5a0a9e909ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Creating volume 2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b 1073741824 Sep 23 00:26:55 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c5b02dd3-b93b-4db7-a92a-dd4994ab6b5c tempest-SnapshotMetadataTestJSON-1785273519 None] Create snapshot completed successfully Sep 23 00:26:55 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b 1073741824" returned: 0 in 0.543s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b Sep 23 00:26:55 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:56 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-518f51cb-d12b-47a6-91ae-588d07ca99a7 req-9ae4a810-8887-48df-97b6-29b32c8b4ba0 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.363s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafdd82-3fd7-44c4-8e68-d413e8fbb655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec26278-c45b-466f-b592-9772c0d8a78b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2d2744-0764-46f1-b084-ef23cb40197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-518f51cb-d12b-47a6-91ae-588d07ca99a7 req-9ae4a810-8887-48df-97b6-29b32c8b4ba0 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Volume volume-2ec26278-c45b-466f-b592-9772c0d8a78b (2ec26278-c45b-466f-b592-9772c0d8a78b): created successfully Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2d2744-0764-46f1-b084-ef23cb40197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Flow 'volume_create_manager' (fa5244e2-9b8e-4dca-8575-09fbe302568d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-40bfeff0-0838-4326-a73a-83aa8e9c8d9e tempest-CinderUnicodeTest-7422869 None] Created volume successfully. Sep 23 00:26:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-518f51cb-d12b-47a6-91ae-588d07ca99a7 req-9ae4a810-8887-48df-97b6-29b32c8b4ba0 tempest-AttachVolumeNegativeTest-279379255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10f02d9a-6d10-43ca-b9cb-e68f6d6b0757', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-518f51cb-d12b-47a6-91ae-588d07ca99a7 req-9ae4a810-8887-48df-97b6-29b32c8b4ba0 tempest-AttachVolumeNegativeTest-279379255 None] attachment_update completed successfully. Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "cinder-113d2fd2-052a-42fb-a882-785a5b642299-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-113d2fd2-052a-42fb-a882-785a5b642299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "cinder-quobyte-113d2fd2-052a-42fb-a882-785a5b642299" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-113d2fd2-052a-42fb-a882-785a5b642299" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Deleting offline snapshot 113d2fd2-052a-42fb-a882-785a5b642299 of volume 22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] snapshot_file for this snap is: volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d7152-b54f-4628-a8a1-f9c3982c20cb]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 Sep 23 00:26:57 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Creating offline snapshot f2936dab-468c-4085-b77e-e172151bea1e of volume 2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d825bf-4a5a-4008-ae53-0b2fe217c8b1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b Sep 23 00:26:57 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f384049-0f66-44b8-bbc3-1e8230419892]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f Sep 23 00:26:57 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b" returned: 0 in 0.477s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e 1G Sep 23 00:26:58 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 Sep 23 00:26:58 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e 1G" returned: 0 in 0.591s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec26278-c45b-466f-b592-9772c0d8a78b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec26278-c45b-466f-b592-9772c0d8a78b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e Sep 23 00:26:58 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299 Sep 23 00:26:58 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b10b2f99-10e4-434f-89ae-d5ec028c1c50 req-d773396d-076c-4c14-9db8-25237d8007c0 tempest-AttachVolumeNegativeTest-279379255 None] Terminate volume connection completed successfully. Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-b10b2f99-10e4-434f-89ae-d5ec028c1c50 req-d773396d-076c-4c14-9db8-25237d8007c0 tempest-AttachVolumeNegativeTest-279379255 None] Deleting attachment 10f02d9a-6d10-43ca-b9cb-e68f6d6b0757. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:26:58 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f.113d2fd2-052a-42fb-a882-785a5b642299" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ec26278-c45b-466f-b592-9772c0d8a78b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:59 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e is being set with open permissions: ugo+rw Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-113d2fd2-052a-42fb-a882-785a5b642299" released by "_delete_snapshot" :: held 1.822s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" released by "delete_snapshot" :: held 1.862s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:59 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e Sep 23 00:26:59 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Created reservations ['c27db00c-a805-48b7-83ba-6f20ebd59162', '6d5f0857-58ab-429e-8533-6b920703b185', 'c9f0ce36-d7da-4057-9700-3d7dc81d3fb9', '50ae0f27-8187-4e14-9451-e71f55360d20', 'a2165ef0-bd06-428c-a8c0-7a8f267dbbc3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:26:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Delete snapshot completed successfully. Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a173d6a9-223a-4dd9-b733-cb4ec2354132 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-113d2fd2-052a-42fb-a882-785a5b642299-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:59 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:59 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info Sep 23 00:26:59 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "cinder-22b79bd4-b5b7-4ef5-a403-1cf47666a19f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-22b79bd4-b5b7-4ef5-a403-1cf47666a19f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74880df8-34f7-4a41-afdf-ec719c67b09b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:59 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:59 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info is being set with open permissions: ugo+rw Sep 23 00:26:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:59 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f Sep 23 00:26:59 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:59 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info Sep 23 00:26:59 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:00 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.info" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:00 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:00 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f Sep 23 00:27:00 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c0a2569-726d-4e4c-b741-11b0f6848b1a tempest-CinderUnicodeTest-7422869 None] Create snapshot completed successfully Sep 23 00:27:00 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-quobyte-22b79bd4-b5b7-4ef5-a403-1cf47666a19f" released by "delete_volume" :: held 1.131s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-f2936dab-468c-4085-b77e-e172151bea1e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-f2936dab-468c-4085-b77e-e172151bea1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Created reservations ['ecd0c817-8408-491b-b714-ab51d0659b3e', 'a4119023-4c4a-4b00-bf45-6eef58037c80', '28bdf66e-586c-47b1-aaeb-29f6cf7934fa', '5e905b60-c870-4c0f-81b0-684ede145ecb', 'df97ca8d-8b24-4f94-b939-f68d766e30d5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-quobyte-f2936dab-468c-4085-b77e-e172151bea1e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-f2936dab-468c-4085-b77e-e172151bea1e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Deleting offline snapshot f2936dab-468c-4085-b77e-e172151bea1e of volume 2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] snapshot_file for this snap is: volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363fd14-840d-4274-9ce9-5ce6d490d108]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:01 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:01 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:01 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e Sep 23 00:27:01 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:01 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Deleted volume successfully. Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9565a5b6-97f9-482d-8b88-e5afe4ba2c70 tempest-SnapshotMetadataTestJSON-1785273519 None] Lock "cinder-22b79bd4-b5b7-4ef5-a403-1cf47666a19f-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:01 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e" returned: 0 in 0.556s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ec26278-c45b-466f-b592-9772c0d8a78b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971ef4e-7dd1-4449-9944-db02737c403d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:01 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b Sep 23 00:27:01 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:02 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:02 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e Sep 23 00:27:02 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:02 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:02 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e Sep 23 00:27:02 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:03 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b.f2936dab-468c-4085-b77e-e172151bea1e" returned: 0 in 0.392s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-f2936dab-468c-4085-b77e-e172151bea1e" released by "_delete_snapshot" :: held 2.281s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" released by "delete_snapshot" :: held 2.319s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Created reservations ['b066fc2d-8a1e-4977-bce9-5a45a057b236', 'f45bb85c-6cf0-4c93-8dc9-febb554d6c21', '529a948f-1e2c-41f8-8a8b-a538267c7bcb', '3aa519bd-222e-4191-80af-436b89e70d24', 'be5650a5-77cb-42fa-ac32-e3ce6c07cbfe'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Delete snapshot completed successfully. Sep 23 00:27:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d97b6fdb-80fd-4df8-ae3f-77f6ca2f8a8f tempest-CinderUnicodeTest-7422869 None] Lock "cinder-f2936dab-468c-4085-b77e-e172151bea1e-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-6ae552ad-d117-4a16-bc28-d81ee1f80f5b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-2ec26278-c45b-466f-b592-9772c0d8a78b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-6ae552ad-d117-4a16-bc28-d81ee1f80f5b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "cinder-2ec26278-c45b-466f-b592-9772c0d8a78b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-quobyte-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16aa174-f95d-4879-b983-fbd244c98cad]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e75d96a-6e27-4472-9770-1ee5ffc0792a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:04 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b Sep 23 00:27:04 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:04 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b Sep 23 00:27:04 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:04 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:04 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b Sep 23 00:27:04 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:04 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:04 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b Sep 23 00:27:04 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:05 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" returned: 0 in 0.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2ec26278-c45b-466f-b592-9772c0d8a78b" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-6ae552ad-d117-4a16-bc28-d81ee1f80f5b" released by "delete_volume" :: held 0.909s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-2ec26278-c45b-466f-b592-9772c0d8a78b" released by "delete_volume" :: held 0.907s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Created reservations ['14012fab-e6a1-4b11-8c63-375c2a809be6', 'a8255bdd-c802-49ed-bd34-9aa7850afc5a', '092c3972-ffeb-4da1-b0e5-d1471f09b355', '8b2b018d-cd3e-4bb2-a558-10abba44d692', 'c5adba3a-7450-40e7-9354-2f620eb1b198'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Created reservations ['d454b8da-f957-4a0e-89ef-5df59971d192', '731b227d-9501-4b79-978b-bec527899da6', '50e2bc55-9d75-49c1-ac7c-e8f852f5317c', 'c28ba88a-7d2a-4a4d-b4ae-6a0e2c591217', 'a237fede-a2ec-4ca8-b76e-cf272fe14854'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:05 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:05 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:05 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:05 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:05 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Deleted volume successfully. Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd0d0021-631b-4690-9bcf-9c709ef641e2 tempest-CinderUnicodeTest-7422869 None] Lock "cinder-2ec26278-c45b-466f-b592-9772c0d8a78b-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:05 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Deleted volume successfully. Sep 23 00:27:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a629a053-f3b9-4788-9cee-cc73d7f2a93d tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-6ae552ad-d117-4a16-bc28-d81ee1f80f5b-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-3b16cbdd-f7f6-4635-bee2-eb137ad82559-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "cinder-3b16cbdd-f7f6-4635-bee2-eb137ad82559-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Acquiring lock "cinder-quobyte-3b16cbdd-f7f6-4635-bee2-eb137ad82559" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-3b16cbdd-f7f6-4635-bee2-eb137ad82559" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-32f6793a-0c48-4620-84e3-916fcece36b6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[581497ba-3c1d-4d75-802b-216ad9022cc0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-32f6793a-0c48-4620-84e3-916fcece36b6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-quobyte-32f6793a-0c48-4620-84e3-916fcece36b6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-32f6793a-0c48-4620-84e3-916fcece36b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa99b1-5c47-4d86-b22a-871fd7c29621]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:06 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 Sep 23 00:27:06 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (f11f9702-d36f-4348-ab94-e08663d5b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a829f5c3-35ae-4ec3-a5b1-28aab1d7e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a829f5c3-35ae-4ec3-a5b1-28aab1d7e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-936310702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f56c2e0-c200-4df4-8cf6-beb06485c206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ee0aa3e3bd4e27b1c8677cbfb9d2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:07Z,use_quota=True,user_id='b17505a3c2054613abf077f3b801cefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:06 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 Sep 23 00:27:06 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2669e1-9615-4e1e-ba93-7afb3cd6ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2669e1-9615-4e1e-ba93-7afb3cd6ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6531a93e-dfed-4b32-b205-8edafb5908b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6531a93e-dfed-4b32-b205-8edafb5908b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f56c2e0-c200-4df4-8cf6-beb06485c206', 'volume_name': 'volume-5f56c2e0-c200-4df4-8cf6-beb06485c206', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565ea032-c879-469b-9a2c-a4904a36994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565ea032-c879-469b-9a2c-a4904a36994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a553ac-e25a-4121-986f-92c001f30f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Volume 5f56c2e0-c200-4df4-8cf6-beb06485c206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f56c2e0-c200-4df4-8cf6-beb06485c206', 'volume_size': 1} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-936310702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f56c2e0-c200-4df4-8cf6-beb06485c206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ee0aa3e3bd4e27b1c8677cbfb9d2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:07Z,use_quota=True,user_id='b17505a3c2054613abf077f3b801cefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Creating volume 5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:06 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:06 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 1073741824 Sep 23 00:27:06 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559 Sep 23 00:27:07 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6 Sep 23 00:27:07 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b16cbdd-f7f6-4635-bee2-eb137ad82559" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "cinder-quobyte-3b16cbdd-f7f6-4635-bee2-eb137ad82559" released by "delete_volume" :: held 0.837s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:07 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 1073741824" returned: 0 in 0.493s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Created reservations ['cd856dd5-d9e7-438c-b4c1-aafb1d8284b6', '78f0e4b8-6394-4b4c-9078-20f4b66a6ef0', '89e4a699-01bf-4000-b5c3-e162479899fd', '4e40c356-4223-4f3e-a987-fa017648a612', '9567b9c0-a670-4db8-ac26-60613a53c644'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32f6793a-0c48-4620-84e3-916fcece36b6" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:07 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-32f6793a-0c48-4620-84e3-916fcece36b6" released by "delete_volume" :: held 0.807s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Created reservations ['163aa37e-03ad-48f9-88de-18456a541c03', '55a9d34e-c475-4384-b1b0-d62fe70025bb', '76881151-97c1-4dd6-a1a8-5ad72a08286c', '954f633b-8af0-41a4-8d1e-b835d5570070', '130cf4f0-5193-4ff1-a967-9403376a3b84'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:07 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:07 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:07 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a553ac-e25a-4121-986f-92c001f30f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f56c2e0-c200-4df4-8cf6-beb06485c206', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0c5610-7380-42f7-88d1-b30f11ba4138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Volume volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 (5f56c2e0-c200-4df4-8cf6-beb06485c206): created successfully Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0c5610-7380-42f7-88d1-b30f11ba4138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (f11f9702-d36f-4348-ab94-e08663d5b506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-727dae0c-8437-4e57-a982-47d1efeb7f8c tempest-VolumesDeleteCascade-237705084 None] Created volume successfully. Sep 23 00:27:08 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Deleted volume successfully. Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e672d647-a2b3-4588-a7b1-26314e52d4bb tempest-CinderUnicodeTest-7422869 None] Lock "cinder-3b16cbdd-f7f6-4635-bee2-eb137ad82559-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:08 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Deleted volume successfully. Sep 23 00:27:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e68669f-b442-48a2-bab1-31a00d16376b tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-32f6793a-0c48-4620-84e3-916fcece36b6-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-55474240-fe09-4fb5-8930-ec46a4b6ef1c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-55474240-fe09-4fb5-8930-ec46a4b6ef1c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "cinder-quobyte-55474240-fe09-4fb5-8930-ec46a4b6ef1c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Creating offline snapshot 6f1f5e12-2655-4691-bdcd-e4dc178f0836 of volume 5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-55474240-fe09-4fb5-8930-ec46a4b6ef1c" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf010d1-3a17-488c-8768-84989cb5636e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d2e7a-6d37-49c4-a522-d25b8822aa77]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:09 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c Sep 23 00:27:09 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 1G Sep 23 00:27:09 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c" returned: 0 in 0.564s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c Sep 23 00:27:09 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:10 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-55474240-fe09-4fb5-8930-ec46a4b6ef1c" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-quobyte-55474240-fe09-4fb5-8930-ec46a4b6ef1c" released by "delete_volume" :: held 1.009s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:10 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 1G" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Created reservations ['faa76ea7-3978-4590-a1ef-8fa8ffdbf66d', 'cb72c672-279e-45ff-8d5f-5b42a109983a', '3bd2145f-41dd-497a-bc58-f2bf4874f731', '12e91bad-9b7c-4fc9-94fc-0bd49cf2da96', 'a77088ce-0ea5-4110-994f-186a54ca4e80'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:10 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:10 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:10 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:10 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:10 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:10 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 is being set with open permissions: ugo+rw Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:10 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:10 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:10 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Deleted volume successfully. Sep 23 00:27:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0df13c52-49b2-47cb-9f33-aa6379050f18 tempest-AttachVolumeNegativeTest-279379255 None] Lock "cinder-55474240-fe09-4fb5-8930-ec46a4b6ef1c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:11 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:11 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info Sep 23 00:27:11 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:11 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info is being set with open permissions: ugo+rw Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:11 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info Sep 23 00:27:11 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:11 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.info" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-58776684-9180-48af-87ad-9527543acac4 tempest-VolumesDeleteCascade-237705084 None] Create snapshot completed successfully Sep 23 00:27:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Creating offline snapshot c9d33494-2400-4abe-aaa6-c936fe1dea2d of volume 5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb387ed-f513-4455-9f17-0203ee049acc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:12 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:12 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:13 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56c2e0-c200-4df4-8cf6-beb06485c206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:13 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d 1G Sep 23 00:27:13 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d 1G" returned: 0 in 0.705s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:14 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d is being set with open permissions: ugo+rw Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:14 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.371s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d72a9bc5-31a8-46a5-bf40-69d7fe74384e tempest-VolumesDeleteCascade-237705084 None] Create snapshot completed successfully Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-5f56c2e0-c200-4df4-8cf6-beb06485c206-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-5f56c2e0-c200-4df4-8cf6-beb06485c206-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Performing cascade delete. {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-6f1f5e12-2655-4691-bdcd-e4dc178f0836-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-6f1f5e12-2655-4691-bdcd-e4dc178f0836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-6f1f5e12-2655-4691-bdcd-e4dc178f0836" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-6f1f5e12-2655-4691-bdcd-e4dc178f0836" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Deleting offline snapshot 6f1f5e12-2655-4691-bdcd-e4dc178f0836 of volume 5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] snapshot_file for this snap is: volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e4242-5c95-423b-8e06-49d4fb8294c3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:16 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:16 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:16 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56c2e0-c200-4df4-8cf6-beb06485c206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ffa3a-7487-4284-859b-d050848b9c4d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:16 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:16 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:17 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0c781c-50d9-4635-88ee-9c74db5d22a7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:17 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:17 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:17 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.537s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56c2e0-c200-4df4-8cf6-beb06485c206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3d9bf-c222-49f1-a79b-d4fe49042f55]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:18 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56c2e0-c200-4df4-8cf6-beb06485c206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb6976-ba08-45e4-ac37-1e51226d364a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:18 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:18 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (f7f4b452-3112-403c-9054-02995399e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e65921f-b8f2-4652-96e8-3b7f1e5a30fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e65921f-b8f2-4652-96e8-3b7f1e5a30fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240064398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714061ea-cbe5-413a-9e3f-2c490f48e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:19Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8502405-ee4a-4074-85d0-d05e8fd06274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8502405-ee4a-4074-85d0-d05e8fd06274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6775400b-4d04-4235-89ca-646bc3cfc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6775400b-4d04-4235-89ca-646bc3cfc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714061ea-cbe5-413a-9e3f-2c490f48e0a9', 'volume_name': 'volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c668392b-cf96-4861-8b3a-7ee7e5106f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c668392b-cf96-4861-8b3a-7ee7e5106f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925f5cdf-9e74-44db-84dc-26d8f0a9a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Volume 714061ea-cbe5-413a-9e3f-2c490f48e0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9', 'volume_size': 1} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240064398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714061ea-cbe5-413a-9e3f-2c490f48e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:19Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Creating volume 714061ea-cbe5-413a-9e3f-2c490f48e0a9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:19 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 1073741824 Sep 23 00:27:19 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836 Sep 23 00:27:19 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.6f1f5e12-2655-4691-bdcd-e4dc178f0836" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d -F qcow2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d -F qcow2 Sep 23 00:27:19 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 1073741824" returned: 0 in 0.515s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 Sep 23 00:27:19 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d -F qcow2" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-6f1f5e12-2655-4691-bdcd-e4dc178f0836" released by "_delete_snapshot" :: held 3.825s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" released by "delete_snapshot" :: held 3.855s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['3fac3f49-1761-4a7f-94ba-d92de86d252a', '4e124b0a-fe75-457a-83a0-b78d5ed2a283', '34785c37-708b-4539-b6b3-35dd395d27eb', 'ea08bcdf-b9e0-4b09-84b8-12f037fb063e', '636568c6-6c0c-4e90-a81d-c189763e259d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:20 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925f5cdf-9e74-44db-84dc-26d8f0a9a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd5a0bb-177c-4805-9710-be2251bbc266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Volume volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 (714061ea-cbe5-413a-9e3f-2c490f48e0a9): created successfully Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd5a0bb-177c-4805-9710-be2251bbc266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (f7f4b452-3112-403c-9054-02995399e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f40b0908-922e-4a70-aa11-333f9b2153de tempest-ProjectReaderTests-1495301066 None] Created volume successfully. Sep 23 00:27:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Delete snapshot completed successfully. Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-6f1f5e12-2655-4691-bdcd-e4dc178f0836-delete_snapshot" released by "delete_snapshot" :: held 4.147s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-c9d33494-2400-4abe-aaa6-c936fe1dea2d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-c9d33494-2400-4abe-aaa6-c936fe1dea2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-c9d33494-2400-4abe-aaa6-c936fe1dea2d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-c9d33494-2400-4abe-aaa6-c936fe1dea2d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Deleting offline snapshot c9d33494-2400-4abe-aaa6-c936fe1dea2d of volume 5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] snapshot_file for this snap is: volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a477f9a5-ed90-4eb5-9173-7fbb87b89506]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:20 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:20 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:20 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56c2e0-c200-4df4-8cf6-beb06485c206(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[834ee545-475b-4eb6-82f0-18e3b4ecc23b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:20 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:20 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:21 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:21 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-714061ea-cbe5-413a-9e3f-2c490f48e0a9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-714061ea-cbe5-413a-9e3f-2c490f48e0a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-quobyte-714061ea-cbe5-413a-9e3f-2c490f48e0a9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-714061ea-cbe5-413a-9e3f-2c490f48e0a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8787a-bf23-4eab-b700-804656b1c480]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d Sep 23 00:27:21 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:21 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 Sep 23 00:27:21 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206.c9d33494-2400-4abe-aaa6-c936fe1dea2d" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-c9d33494-2400-4abe-aaa6-c936fe1dea2d" released by "_delete_snapshot" :: held 1.719s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" released by "delete_snapshot" :: held 1.742s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['093138fb-33ac-4625-b0ca-c813b67e99f8', 'ed72eabb-7e23-4472-b519-3214856ac124', 'b13e9091-abbd-4914-a36a-815419ece6e9', '5a8f7c9b-dd87-441f-a5d3-c90b499e0e0d', '7121d38f-a814-4a64-8b05-00752bade9f0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9 Sep 23 00:27:22 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Delete snapshot completed successfully. Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-c9d33494-2400-4abe-aaa6-c936fe1dea2d-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Snapshots deleted, issuing volume delete {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b431a1-c8bc-4c7b-a55b-77c2c31ad3f3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6bc89c2-a4b2-4030-a6e8-0821d7656f1c tempest-GroupsV320Test-93753474 None] Group tempest-GroupsV320Test-Group-2122709543: creating Sep 23 00:27:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6bc89c2-a4b2-4030-a6e8-0821d7656f1c tempest-GroupsV320Test-93753474 None] Group tempest-GroupsV320Test-Group-2122709543: created successfully Sep 23 00:27:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6bc89c2-a4b2-4030-a6e8-0821d7656f1c tempest-GroupsV320Test-93753474 None] Create group completed successfully. Sep 23 00:27:22 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:22 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-714061ea-cbe5-413a-9e3f-2c490f48e0a9" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-714061ea-cbe5-413a-9e3f-2c490f48e0a9" released by "delete_volume" :: held 0.842s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Created reservations ['083a8a34-1fae-40a8-8b8a-3b42df39b3a4', '37e052c6-13a5-4d04-baa9-bd8be7eafd32', 'cf20deb3-cf9e-4384-b5cb-94316d9a586e', 'b8e25e22-a30f-442c-88e8-1dfab13ab53c', '2579a706-c0b7-459e-acea-1bc2656ea55c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:22 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206 Sep 23 00:27:22 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Deleted volume successfully. Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e3ab34eb-b49f-4932-a172-4e8b27b33f7e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-714061ea-cbe5-413a-9e3f-2c490f48e0a9-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:23 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5f56c2e0-c200-4df4-8cf6-beb06485c206" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-5f56c2e0-c200-4df4-8cf6-beb06485c206" released by "delete_volume" :: held 0.866s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['1aaaf325-efdd-43a4-a60b-3d136893b0a0', '10bbfe38-5ee1-481e-b208-bb905ed7e986', '256a14b9-738c-41b8-9b4b-e3cd69f882e2', 'bd46b480-2fa0-4f3c-ab6c-6bb843d149c8', '2d4867a7-3aff-48b6-9f0d-dd4b0f4ad995'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:23 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:23 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (4a57ea0d-aaab-40ac-a155-f5eb51feeec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d89b1aa-20d8-4c65-aa99-0b7a04199e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d89b1aa-20d8-4c65-aa99-0b7a04199e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684424636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf37e57-1a18-4e13-9c46-020f4f5fa79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:23Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d8d1c1-ba8b-4291-9b12-cf0051f1e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d8d1c1-ba8b-4291-9b12-cf0051f1e031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d09163-b908-4803-8d7f-aba58c269379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d09163-b908-4803-8d7f-aba58c269379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf37e57-1a18-4e13-9c46-020f4f5fa79b', 'volume_name': 'volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2d328f-c980-41f2-a12d-2c5f01b02910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2d328f-c980-41f2-a12d-2c5f01b02910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067974c7-b34b-414b-ba83-0c70be3f2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Volume cdf37e57-1a18-4e13-9c46-020f4f5fa79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b', 'volume_size': 1} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684424636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf37e57-1a18-4e13-9c46-020f4f5fa79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:23Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Creating volume cdf37e57-1a18-4e13-9c46-020f4f5fa79b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:23 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b 1073741824 Sep 23 00:27:23 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Deleted volume successfully. Sep 23 00:27:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c7ca8bdf-35d7-4238-bcaf-86518a328285 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-5f56c2e0-c200-4df4-8cf6-beb06485c206-delete_volume" released by "delete_volume" :: held 7.667s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Created reservations ['3880320f-edce-42f3-a7de-68158de458a8'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:24 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:24 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b 1073741824" returned: 0 in 0.624s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b Sep 23 00:27:24 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:24 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4e1883f8-0009-4632-80f5-94c010a1b38b tempest-GroupsV320Test-93753474 None] Delete group completed successfully. Sep 23 00:27:24 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067974c7-b34b-414b-ba83-0c70be3f2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441d6c5f-385d-4a17-94c4-e7de2d719a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Volume volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b (cdf37e57-1a18-4e13-9c46-020f4f5fa79b): created successfully Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441d6c5f-385d-4a17-94c4-e7de2d719a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (4a57ea0d-aaab-40ac-a155-f5eb51feeec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-553b9bb7-da6d-4d43-a851-b785da753b78 tempest-ProjectReaderTests-1495301066 None] Created volume successfully. Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (e8f916d8-ec2f-47c0-bb87-300a2f526880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a3444-d554-4b63-b53b-e0c18dc8e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7a3444-d554-4b63-b53b-e0c18dc8e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-763178719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af481ce6-6c2d-49b5-a356-bcdea0af1335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ee0aa3e3bd4e27b1c8677cbfb9d2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='b17505a3c2054613abf077f3b801cefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7146b7-6a1d-4667-9e0e-ac5b833e853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7146b7-6a1d-4667-9e0e-ac5b833e853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e335faf-85a7-47f1-a688-4f82f03a55b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e335faf-85a7-47f1-a688-4f82f03a55b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af481ce6-6c2d-49b5-a356-bcdea0af1335', 'volume_name': 'volume-af481ce6-6c2d-49b5-a356-bcdea0af1335', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf475bb-3579-4edc-bdfa-b16a27c39906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf475bb-3579-4edc-bdfa-b16a27c39906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1e6bed-be60-4e3f-8fa1-b0d57753eda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Volume af481ce6-6c2d-49b5-a356-bcdea0af1335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af481ce6-6c2d-49b5-a356-bcdea0af1335', 'volume_size': 1} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-763178719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af481ce6-6c2d-49b5-a356-bcdea0af1335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ee0aa3e3bd4e27b1c8677cbfb9d2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:25Z,use_quota=True,user_id='b17505a3c2054613abf077f3b801cefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Creating volume af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 1073741824 Sep 23 00:27:24 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 1073741824" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:25 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:25 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-cdf37e57-1a18-4e13-9c46-020f4f5fa79b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-cdf37e57-1a18-4e13-9c46-020f4f5fa79b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:25 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1e6bed-be60-4e3f-8fa1-b0d57753eda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af481ce6-6c2d-49b5-a356-bcdea0af1335', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933b2b9f-4f5d-4975-803c-bdc53b8e1dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Volume volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 (af481ce6-6c2d-49b5-a356-bcdea0af1335): created successfully Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933b2b9f-4f5d-4975-803c-bdc53b8e1dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (e8f916d8-ec2f-47c0-bb87-300a2f526880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-quobyte-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dfd14ac0-a834-4afe-821c-4d112f68a813 tempest-VolumesDeleteCascade-237705084 None] Created volume successfully. Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97214f73-f48b-4c3f-a12d-8b60863863d3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b Sep 23 00:27:26 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b Sep 23 00:27:26 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" returned: 0 in 0.404s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-cdf37e57-1a18-4e13-9c46-020f4f5fa79b" released by "delete_volume" :: held 0.914s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Created reservations ['f84bf3e1-e556-4b5b-a865-aa32e717b2dc', '3d77a58f-1da4-43d5-832e-59188e2e620c', '4eb5c099-3885-4b24-a809-7d0df7605622', 'b4b217c3-1233-4e0f-94e9-38a9c3e5a14c', '1588835d-2004-478a-b1d5-b48c68a64ce7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:27 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Creating offline snapshot 472c3c7d-0234-40e7-b61f-441b3caf778c of volume af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7c48f-76cc-4e16-ac83-a6143955882f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Deleted volume successfully. Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-752c37cf-d41b-41a4-bc57-4be56eca1f8e tempest-ProjectReaderTests-1495301066 None] Lock "cinder-cdf37e57-1a18-4e13-9c46-020f4f5fa79b-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:27 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:27 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c 1G Sep 23 00:27:27 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:28 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c 1G" returned: 0 in 0.610s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:28 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:28 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:28 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:28 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c is being set with open permissions: ugo+rw Sep 23 00:27:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:28 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:28 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (0de169a8-03bf-4e37-9075-2175b6c8cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563d8ee1-774c-4836-966c-9bc01c67219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563d8ee1-774c-4836-966c-9bc01c67219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472244505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3a7a0-c25a-4e4d-adc0-f620c4286e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ffdcf3-604a-4e4a-91f7-c0440da89c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ffdcf3-604a-4e4a-91f7-c0440da89c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ed5b5c-1715-4e5f-bb30-60d6219c86ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ed5b5c-1715-4e5f-bb30-60d6219c86ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a3a7a0-c25a-4e4d-adc0-f620c4286e01', 'volume_name': 'volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07081ba0-83c2-4318-bdee-e5ca706e1e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07081ba0-83c2-4318-bdee-e5ca706e1e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1327baa-9956-4dd7-a29f-7db5d642d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:29 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Volume 08a3a7a0-c25a-4e4d-adc0-f620c4286e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01', 'volume_size': 1} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info Sep 23 00:27:29 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info is being set with open permissions: ugo+rw Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info Sep 23 00:27:29 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.info" returned: 0 in 0.338s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472244505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a3a7a0-c25a-4e4d-adc0-f620c4286e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:29Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Creating volume 08a3a7a0-c25a-4e4d-adc0-f620c4286e01 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:29 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 1073741824 Sep 23 00:27:29 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9e47d3b3-d9ee-4d34-9c4d-dc44eef3d783 tempest-VolumesDeleteCascade-237705084 None] Create snapshot completed successfully Sep 23 00:27:30 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 1073741824" returned: 0 in 0.570s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 Sep 23 00:27:30 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1327baa-9956-4dd7-a29f-7db5d642d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67519d2-9e05-4b20-8d44-c32d2e927d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Volume volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 (08a3a7a0-c25a-4e4d-adc0-f620c4286e01): created successfully Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67519d2-9e05-4b20-8d44-c32d2e927d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (0de169a8-03bf-4e37-9075-2175b6c8cb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-50034601-5d8a-4e75-8e8a-1088e3a90d99 tempest-ProjectReaderTests-1495301066 None] Created volume successfully. Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-08a3a7a0-c25a-4e4d-adc0-f620c4286e01-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-08a3a7a0-c25a-4e4d-adc0-f620c4286e01-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-quobyte-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (d13fc61e-c0de-487e-b0be-08e380adc796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6796d-29ea-4f9e-a465-f40249c43ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" acquired by "delete_volume" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb6796d-29ea-4f9e-a465-f40249c43ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-702030442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c3936-c0c0-4e20-aaed-95f8fad08556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ee0aa3e3bd4e27b1c8677cbfb9d2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=472c3c7d-0234-40e7-b61f-441b3caf778c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:31Z,use_quota=True,user_id='b17505a3c2054613abf077f3b801cefd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65649a45-62b2-4ec7-a1ca-e3e773bdb70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65649a45-62b2-4ec7-a1ca-e3e773bdb70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1cf3a5-d94f-4fc5-a60b-cbffb30f5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1cf3a5-d94f-4fc5-a60b-cbffb30f5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb8c3936-c0c0-4e20-aaed-95f8fad08556', 'volume_name': 'volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556', 'volume_size': 1, 'snapshot_id': '472c3c7d-0234-40e7-b61f-441b3caf778c'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fb664b-575e-4873-9c68-9507fa7f30aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fb664b-575e-4873-9c68-9507fa7f30aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b9656f-3a26-41c9-8c71-0e981733a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Volume cb8c3936-c0c0-4e20-aaed-95f8fad08556: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556', 'volume_size': 1, 'snapshot_id': '472c3c7d-0234-40e7-b61f-441b3caf778c'} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1685b17-8246-478d-8a09-f4e7f4e504c0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c-cb8c3936-c0c0-4e20-aaed-95f8fad08556" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c-cb8c3936-c0c0-4e20-aaed-95f8fad08556" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Creating volume cb8c3936-c0c0-4e20-aaed-95f8fad08556 from snapshot 472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] snapshot: 472c3c7d-0234-40e7-b61f-441b3caf778c, volume: cb8c3936-c0c0-4e20-aaed-95f8fad08556, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:27:31 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 Sep 23 00:27:31 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b404c-6c78-4eb8-818c-d4b789609409]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:31 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01 Sep 23 00:27:31 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af481ce6-6c2d-49b5-a356-bcdea0af1335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[087e1a7a-05d0-4390-87e1-1edddc2e9db3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-08a3a7a0-c25a-4e4d-adc0-f620c4286e01" released by "delete_volume" :: held 0.816s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:32 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:32 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Created reservations ['37b636c0-65f0-4ece-9b90-5e2f78da1244', 'a8ce4a5c-73eb-4f8e-923c-2ad38d832a83', '10ba550a-6979-466f-a363-827396a3aa5e', 'a7320af9-4179-4382-9315-8af21b3b50a6', 'a6e42678-341d-4044-ab54-f0dd5f3d9540'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:32 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 Sep 23 00:27:32 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.354s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Deleted volume successfully. Sep 23 00:27:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-25e31aa5-1958-4deb-844f-94d86e826f00 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-08a3a7a0-c25a-4e4d-adc0-f620c4286e01-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (b84aeace-70c3-4d6d-b424-00b4e9257555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a69e84-3024-4cac-b464-cf417debb24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a69e84-3024-4cac-b464-cf417debb24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985438319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86adf81c-bd69-4a47-b648-2fab3d267438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8f4750-1981-4910-b368-b9b2aa61bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8f4750-1981-4910-b368-b9b2aa61bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d018d5da-b6f2-4ae5-9b71-f89c594c743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d018d5da-b6f2-4ae5-9b71-f89c594c743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86adf81c-bd69-4a47-b648-2fab3d267438', 'volume_name': 'volume-86adf81c-bd69-4a47-b648-2fab3d267438', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d513e8-65f6-4685-b540-218b9298740b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d513e8-65f6-4685-b540-218b9298740b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcddf4d-c08b-4157-a05c-2a24c25a6886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Volume 86adf81c-bd69-4a47-b648-2fab3d267438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86adf81c-bd69-4a47-b648-2fab3d267438', 'volume_size': 1} Sep 23 00:27:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:37 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:40 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556" returned: 0 in 7.469s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:40 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Converted 1024.00 MB image at 137.09 MB/s Sep 23 00:27:40 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 is being set with open permissions: ugo+rw Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:40 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 Sep 23 00:27:40 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:40 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" released by "_copy_volume_from_snapshot" :: held 8.830s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=180,cinder:SELECT=156,cinder:INSERT=51,cinder:DELETE=15 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=159,cinder:INSERT=49,cinder:UPDATE=187,cinder:DELETE=12 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c-cb8c3936-c0c0-4e20-aaed-95f8fad08556" released by "_create_volume_from_snapshot" :: held 8.934s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.953s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.139s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985438319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86adf81c-bd69-4a47-b648-2fab3d267438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a6f66eb61542e9be13c96817f4eddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:33Z,use_quota=True,user_id='5aab650da25e4d47a144fd28f79ad007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Creating volume 86adf81c-bd69-4a47-b648-2fab3d267438 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:40 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:40 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 1073741824 Sep 23 00:27:40 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b9656f-3a26-41c9-8c71-0e981733a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556', 'volume_size': 1, 'snapshot_id': '472c3c7d-0234-40e7-b61f-441b3caf778c'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af828d08-adc1-4126-8ad6-aceb8a8be6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Volume volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 (cb8c3936-c0c0-4e20-aaed-95f8fad08556): created successfully Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af828d08-adc1-4126-8ad6-aceb8a8be6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Flow 'volume_create_manager' (d13fc61e-c0de-487e-b0be-08e380adc796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c30052c1-5ffa-4ed3-9af1-233681f993e6 tempest-VolumesDeleteCascade-237705084 None] Created volume successfully. Sep 23 00:27:40 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 1073741824" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:40 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 Sep 23 00:27:40 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:41 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcddf4d-c08b-4157-a05c-2a24c25a6886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86adf81c-bd69-4a47-b648-2fab3d267438', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56130706-8656-4407-9475-1cbc833fb650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-af481ce6-6c2d-49b5-a356-bcdea0af1335-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Volume volume-86adf81c-bd69-4a47-b648-2fab3d267438 (86adf81c-bd69-4a47-b648-2fab3d267438): created successfully Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56130706-8656-4407-9475-1cbc833fb650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Flow 'volume_create_manager' (b84aeace-70c3-4d6d-b424-00b4e9257555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-af481ce6-6c2d-49b5-a356-bcdea0af1335-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-78f62f14-c7e0-4784-bf9e-8ebc7246367d tempest-ProjectReaderTests-1495301066 None] Created volume successfully. Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Performing cascade delete. {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-472c3c7d-0234-40e7-b61f-441b3caf778c-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-472c3c7d-0234-40e7-b61f-441b3caf778c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Deleting offline snapshot 472c3c7d-0234-40e7-b61f-441b3caf778c of volume af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] snapshot_file for this snap is: volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1faa5f-9981-4460-a5ef-8b135988fa46]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:41 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:41 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af481ce6-6c2d-49b5-a356-bcdea0af1335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-86adf81c-bd69-4a47-b648-2fab3d267438-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657f225-740d-46ea-887a-1f288248bf3e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-86adf81c-bd69-4a47-b648-2fab3d267438-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "cinder-quobyte-86adf81c-bd69-4a47-b648-2fab3d267438" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-86adf81c-bd69-4a47-b648-2fab3d267438" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd51913-72bf-4b24-964b-270cd3e2ba2f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:42 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 Sep 23 00:27:42 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438 Sep 23 00:27:42 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.700s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:42 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:42 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:42 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-86adf81c-bd69-4a47-b648-2fab3d267438" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-quobyte-86adf81c-bd69-4a47-b648-2fab3d267438" released by "delete_volume" :: held 0.836s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Created reservations ['511b0a2e-c463-4a0c-96f0-3224691e8b79', '03146d0b-bc0c-44d3-bdc0-b9ed26ef915f', '8854d183-ab42-4683-8ecb-892d9b9e296f', '487c0f3f-f341-4c26-8311-e1ebe1f3cf9b', '244c8e56-b575-41b7-b044-eaee84c6bb37'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:43 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:43 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:43 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:43 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c Sep 23 00:27:43 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:43 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.489s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Deleted volume successfully. Sep 23 00:27:43 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f2e9ba7-920a-4a6a-9eea-5ccde9f74810 tempest-ProjectReaderTests-1495301066 None] Lock "cinder-86adf81c-bd69-4a47-b648-2fab3d267438-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335.472c3c7d-0234-40e7-b61f-441b3caf778c" returned: 0 in 0.492s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Flow 'volume_create_manager' (f8a871f9-e26b-4ac9-a77c-56e09876b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6711a3f5-f2d1-458c-b1ca-7c8074a3beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-472c3c7d-0234-40e7-b61f-441b3caf778c" released by "_delete_snapshot" :: held 2.391s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" released by "delete_snapshot" :: held 2.423s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6711a3f5-f2d1-458c-b1ca-7c8074a3beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086172649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4d5abb-004e-4924-bf92-43571216bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378a1f9be00f48c38d1f5e43f78f64a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:44Z,use_quota=True,user_id='7363bbfbfe3a42c09bcc1dc3a4b16f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e568e71-b6eb-4a59-af6d-f39c2e5e3eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e568e71-b6eb-4a59-af6d-f39c2e5e3eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d26681c-ab6c-4938-9fb3-4130421fef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d26681c-ab6c-4938-9fb3-4130421fef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4d5abb-004e-4924-bf92-43571216bf13', 'volume_name': 'volume-9f4d5abb-004e-4924-bf92-43571216bf13', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d02a636-7b9b-4ec7-a197-053a881918ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d02a636-7b9b-4ec7-a197-053a881918ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b6c0f-8823-49d6-a26f-9693f8ab8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume 9f4d5abb-004e-4924-bf92-43571216bf13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4d5abb-004e-4924-bf92-43571216bf13', 'volume_size': 1} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2086172649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4d5abb-004e-4924-bf92-43571216bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378a1f9be00f48c38d1f5e43f78f64a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:44Z,use_quota=True,user_id='7363bbfbfe3a42c09bcc1dc3a4b16f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Creating volume 9f4d5abb-004e-4924-bf92-43571216bf13 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 1073741824 Sep 23 00:27:44 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['adfc2407-d418-4a63-9daf-f6239b4517d0', '45359169-fa6b-4981-bcec-19544d6855df', '81ba28b5-1297-41a4-9bb4-74d98c73b0ae', 'a7c35333-1c42-43b7-a855-f8fddb211979', '0fa2523a-0468-491f-a907-272285dccc75'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Delete snapshot completed successfully. Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-472c3c7d-0234-40e7-b61f-441b3caf778c-delete_snapshot" released by "delete_snapshot" :: held 2.752s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Snapshots deleted, issuing volume delete {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ef663-f132-4278-b21c-7b62b09a6a7f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:44 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:44 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 1073741824" returned: 0 in 0.649s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 Sep 23 00:27:44 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:44 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:44 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335 Sep 23 00:27:44 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b6c0f-8823-49d6-a26f-9693f8ab8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4d5abb-004e-4924-bf92-43571216bf13', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d9ef3d-4804-4a7e-8d35-9f2b99e9c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume volume-9f4d5abb-004e-4924-bf92-43571216bf13 (9f4d5abb-004e-4924-bf92-43571216bf13): created successfully Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d9ef3d-4804-4a7e-8d35-9f2b99e9c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Flow 'volume_create_manager' (f8a871f9-e26b-4ac9-a77c-56e09876b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ba731809-0c51-41c7-b6c9-6eb31408b844 tempest-VolumeQuotasAdminTestJSON-478253061 None] Created volume successfully. Sep 23 00:27:45 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-af481ce6-6c2d-49b5-a356-bcdea0af1335" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-af481ce6-6c2d-49b5-a356-bcdea0af1335" released by "delete_volume" :: held 0.984s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['4623843a-dafb-49a0-8fea-8348a67298a6', 'ed4f32d8-78a3-4812-8573-4bb5c95d5658', 'e60d5e9e-a504-4c84-a739-e3d1ba49c742', 'b79afec8-5395-461c-93fd-b11eeaa48f1e', '8be3c900-844d-44b7-bd67-f03144fc0162'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:45 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:45 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Deleted volume successfully. Sep 23 00:27:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-44a43cdf-33d6-4ff9-9648-a1d83a4d43e1 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-af481ce6-6c2d-49b5-a356-bcdea0af1335-delete_volume" released by "delete_volume" :: held 4.390s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "cinder-9f4d5abb-004e-4924-bf92-43571216bf13-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-cb8c3936-c0c0-4e20-aaed-95f8fad08556-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "cinder-9f4d5abb-004e-4924-bf92-43571216bf13-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-cb8c3936-c0c0-4e20-aaed-95f8fad08556-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "cinder-quobyte-9f4d5abb-004e-4924-bf92-43571216bf13" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "cinder-quobyte-9f4d5abb-004e-4924-bf92-43571216bf13" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" acquired by "delete_volume" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d9d3c-9ace-4cbd-a662-3f6d41926ccc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa40bc-4ba9-4b83-a7f6-efeecc45c370]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:46 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 Sep 23 00:27:46 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 Sep 23 00:27:46 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13" returned: 0 in 0.451s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:46 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556 Sep 23 00:27:46 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13 Sep 23 00:27:46 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:46 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cb8c3936-c0c0-4e20-aaed-95f8fad08556" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-quobyte-cb8c3936-c0c0-4e20-aaed-95f8fad08556" released by "delete_volume" :: held 0.742s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:46 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9f4d5abb-004e-4924-bf92-43571216bf13" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "cinder-quobyte-9f4d5abb-004e-4924-bf92-43571216bf13" released by "delete_volume" :: held 0.795s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Created reservations ['1c25c4fc-8d6c-4e8f-a972-05de085e484e', '726bafc3-0876-42d5-b66f-047628ff8db3', '184af35f-ced5-4384-8dfc-c729362d1630', '6e91a09e-3969-4fbc-b3bf-0baecf04fa68', 'b70e4d5a-5e1c-4edc-af05-05be1bcf7a00'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Created reservations ['68a98867-6bd2-4e23-bb67-933fbb351212', '2bf3a1e7-ec5b-46ed-b737-dbd0783268f9', '6d496807-f812-4996-ad02-26a1f97bbd72', 'e654418e-ce7c-4d6d-bc13-a809b409d0d4', 'f390fff2-f873-4fe2-98ca-b2d676b513c5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:47 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:47 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:47 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Deleted volume successfully. Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-be44393d-efa3-4647-af9e-ca6d3bbdb784 tempest-VolumesDeleteCascade-237705084 None] Lock "cinder-cb8c3936-c0c0-4e20-aaed-95f8fad08556-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:47 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.335s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Deleted volume successfully. Sep 23 00:27:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43144c7b-0055-4f17-85e2-7cc7370c2dad tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "cinder-9f4d5abb-004e-4924-bf92-43571216bf13-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Flow 'volume_create_manager' (9029d19d-7f77-4828-a766-39d9383bfdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4159853-df43-404f-87ea-269d704032d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4159853-df43-404f-87ea-269d704032d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-450176404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2054476-c054-404b-b873-bb0de5ede491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378a1f9be00f48c38d1f5e43f78f64a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:48Z,use_quota=True,user_id='7363bbfbfe3a42c09bcc1dc3a4b16f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f543a-4a4b-4a2e-ba12-eb770a35f711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f543a-4a4b-4a2e-ba12-eb770a35f711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78b4536-6a3e-4b0d-ae43-70f65437a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78b4536-6a3e-4b0d-ae43-70f65437a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2054476-c054-404b-b873-bb0de5ede491', 'volume_name': 'volume-a2054476-c054-404b-b873-bb0de5ede491', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbdb557-78ab-4752-abaf-1fbd3fc64762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbdb557-78ab-4752-abaf-1fbd3fc64762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a979589-95c0-4cdc-be14-1802e065e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume a2054476-c054-404b-b873-bb0de5ede491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2054476-c054-404b-b873-bb0de5ede491', 'volume_size': 1} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-450176404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2054476-c054-404b-b873-bb0de5ede491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378a1f9be00f48c38d1f5e43f78f64a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:48Z,use_quota=True,user_id='7363bbfbfe3a42c09bcc1dc3a4b16f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Creating volume a2054476-c054-404b-b873-bb0de5ede491 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:48 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 1073741824 Sep 23 00:27:48 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:48 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 1073741824" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:48 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 Sep 23 00:27:48 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a979589-95c0-4cdc-be14-1802e065e775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2054476-c054-404b-b873-bb0de5ede491', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94a53b-900a-4f7f-9db4-3f7dd6620654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Volume volume-a2054476-c054-404b-b873-bb0de5ede491 (a2054476-c054-404b-b873-bb0de5ede491): created successfully Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94a53b-900a-4f7f-9db4-3f7dd6620654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Flow 'volume_create_manager' (9029d19d-7f77-4828-a766-39d9383bfdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-db222cd3-5327-402f-b5aa-29cca8e18e68 tempest-VolumeQuotasAdminTestJSON-478253061 None] Created volume successfully. Sep 23 00:27:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-23c01dfa-9c3e-48a0-bd96-3b680d4d6bc0 tempest-VolumeQuotasAdminTestJSON-1210254594 None] Transfer volume completed successfully. Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Acquiring lock "cinder-a2054476-c054-404b-b873-bb0de5ede491-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "cinder-a2054476-c054-404b-b873-bb0de5ede491-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Acquiring lock "cinder-quobyte-a2054476-c054-404b-b873-bb0de5ede491" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "cinder-quobyte-a2054476-c054-404b-b873-bb0de5ede491" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2125d1-a9ab-4f92-a9ef-0e7321082cdf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:51 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 Sep 23 00:27:51 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:52 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491 Sep 23 00:27:52 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-a2054476-c054-404b-b873-bb0de5ede491" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "cinder-quobyte-a2054476-c054-404b-b873-bb0de5ede491" released by "delete_volume" :: held 0.789s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Created reservations ['e7d41ba7-57b5-41fc-9526-d24d43d79072', 'a0341d24-51a5-40ca-b0fa-7af4d643974b', '70202360-131a-46b2-827a-4efa2e2823d0', '935f1a2c-4b64-4619-a627-d7a85239292a', '921524de-b807-4f97-97b3-02be241dbf6e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:52 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:52 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Deleted volume successfully. Sep 23 00:27:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c790532-bd62-456b-956e-f1e3034866ed tempest-VolumeQuotasAdminTestJSON-2081211541 None] Lock "cinder-a2054476-c054-404b-b873-bb0de5ede491-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Flow 'volume_create_manager' (97adc678-9848-4ea8-a66e-81ec61c9cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9712bb3a-39a0-4e57-8d9b-30cdd296f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9712bb3a-39a0-4e57-8d9b-30cdd296f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-368434849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd08b72c-4d9f-4c00-917b-c9919ee540b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20272db29f4b483eaa5a41791acf37fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:53Z,use_quota=True,user_id='b2c8c2659ee047b1b0bd7021c0439034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064372f1-a094-4963-a770-1294f8cb8d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064372f1-a094-4963-a770-1294f8cb8d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020fe02f-02c6-40f4-9e6c-c9b8a8538189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020fe02f-02c6-40f4-9e6c-c9b8a8538189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd08b72c-4d9f-4c00-917b-c9919ee540b3', 'volume_name': 'volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa2c234-8f08-4ba3-a60e-c081d10438e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa2c234-8f08-4ba3-a60e-c081d10438e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02741a99-795c-4ae8-b9eb-c8dab62a5fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:53 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Volume cd08b72c-4d9f-4c00-917b-c9919ee540b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3', 'volume_size': 1} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-368434849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd08b72c-4d9f-4c00-917b-c9919ee540b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20272db29f4b483eaa5a41791acf37fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:53Z,use_quota=True,user_id='b2c8c2659ee047b1b0bd7021c0439034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Creating volume cd08b72c-4d9f-4c00-917b-c9919ee540b3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:53 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:53 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 1073741824 Sep 23 00:27:53 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:54 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 1073741824" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:54 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 Sep 23 00:27:54 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:54 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02741a99-795c-4ae8-b9eb-c8dab62a5fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abaa69-fb9a-41da-ba8b-e9962fe9feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Volume volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 (cd08b72c-4d9f-4c00-917b-c9919ee540b3): created successfully Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abaa69-fb9a-41da-ba8b-e9962fe9feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Flow 'volume_create_manager' (97adc678-9848-4ea8-a66e-81ec61c9cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aa277c54-2f9f-40f9-9e73-11d37e7a7623 tempest-VolumesTransfersV355Test-1812053917 None] Created volume successfully. Sep 23 00:27:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dda6d5cf-36dd-4986-bf85-16ead07f5479 tempest-VolumesTransfersV355Test-45270163 None] Transfer volume completed successfully. Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "cinder-cd08b72c-4d9f-4c00-917b-c9919ee540b3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-cd08b72c-4d9f-4c00-917b-c9919ee540b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "cinder-quobyte-cd08b72c-4d9f-4c00-917b-c9919ee540b3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-quobyte-cd08b72c-4d9f-4c00-917b-c9919ee540b3" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8272b-8eaf-4ff4-a3a4-e777ba6f346a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 Sep 23 00:27:58 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3 Sep 23 00:27:58 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cd08b72c-4d9f-4c00-917b-c9919ee540b3" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-quobyte-cd08b72c-4d9f-4c00-917b-c9919ee540b3" released by "delete_volume" :: held 0.798s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Created reservations ['b7a08864-ac2a-4bc9-a156-8392d53e8362', '115c43b5-1a65-4a8c-9996-ad115259993f', '1bf7330b-57a4-4fe8-b537-91525fa2e110', '052b2c17-d6d8-4421-956b-a6004935e7ad', '7a9ecd2b-c457-4c2b-913a-59260fa2ccc6'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:27:58 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:59 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Deleted volume successfully. Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ba5561d-a9d3-4632-b5d2-4779d134a57c tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-cd08b72c-4d9f-4c00-917b-c9919ee540b3-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Flow 'volume_create_manager' (080af46d-217a-4d4c-b8cc-7acee59de4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954eb027-02bb-4111-8d0a-15dead557a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954eb027-02bb-4111-8d0a-15dead557a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1669359713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178786da-9f92-4c2a-9866-9aa396d1f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20272db29f4b483eaa5a41791acf37fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='b2c8c2659ee047b1b0bd7021c0439034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd2919-67b4-4eee-ba1a-c88130a3c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bd2919-67b4-4eee-ba1a-c88130a3c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74cca3c-6c14-4739-a6f6-de5bb1b4bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74cca3c-6c14-4739-a6f6-de5bb1b4bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178786da-9f92-4c2a-9866-9aa396d1f95a', 'volume_name': 'volume-178786da-9f92-4c2a-9866-9aa396d1f95a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff52887-a7f1-4dcb-9d44-bd354da303f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff52887-a7f1-4dcb-9d44-bd354da303f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab49cea2-6f2c-4b65-94eb-ce325cc2fb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Volume 178786da-9f92-4c2a-9866-9aa396d1f95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178786da-9f92-4c2a-9866-9aa396d1f95a', 'volume_size': 1} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1669359713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178786da-9f92-4c2a-9866-9aa396d1f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20272db29f4b483eaa5a41791acf37fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:00Z,use_quota=True,user_id='b2c8c2659ee047b1b0bd7021c0439034',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Creating volume 178786da-9f92-4c2a-9866-9aa396d1f95a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:27:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:59 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a 1073741824 Sep 23 00:27:59 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:00 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a 1073741824" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:00 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a Sep 23 00:28:00 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:00 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a" returned: 0 in 0.303s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab49cea2-6f2c-4b65-94eb-ce325cc2fb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178786da-9f92-4c2a-9866-9aa396d1f95a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb610566-c0b7-45bb-9123-289c3fd4d571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Volume volume-178786da-9f92-4c2a-9866-9aa396d1f95a (178786da-9f92-4c2a-9866-9aa396d1f95a): created successfully Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb610566-c0b7-45bb-9123-289c3fd4d571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Flow 'volume_create_manager' (080af46d-217a-4d4c-b8cc-7acee59de4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b22d04ec-929a-42a1-a0bb-5bc0eca3d366 tempest-VolumesTransfersV355Test-1812053917 None] Created volume successfully. Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "cinder-178786da-9f92-4c2a-9866-9aa396d1f95a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-178786da-9f92-4c2a-9866-9aa396d1f95a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "cinder-quobyte-178786da-9f92-4c2a-9866-9aa396d1f95a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-quobyte-178786da-9f92-4c2a-9866-9aa396d1f95a" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b9542-bc39-4907-8b85-25b0b6335229]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a Sep 23 00:28:02 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Flow 'volume_create_manager' (288c01f6-ffa4-4dd6-a74d-81bc88bc8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832fd0c5-3039-4f00-9e9e-7cc129a402b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832fd0c5-3039-4f00-9e9e-7cc129a402b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1857976730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55daf5c-b79f-41c9-ba20-ff08895111e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68460f0d999e468086c0dd7ced0519c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='4923b45ab594483e97e2cddefdf36202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(647f91bc-b7e5-4515-a46e-f686734945b5),volume_type_id=647f91bc-b7e5-4515-a46e-f686734945b5)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1096a0d-b320-4c75-91ab-9717240fad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1096a0d-b320-4c75-91ab-9717240fad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dcc8aa-31e4-4599-a798-9b715f3b88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dcc8aa-31e4-4599-a798-9b715f3b88d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55daf5c-b79f-41c9-ba20-ff08895111e5', 'volume_name': 'volume-b55daf5c-b79f-41c9-ba20-ff08895111e5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db8e4a5-4908-4e1f-a90e-6fd7da241952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db8e4a5-4908-4e1f-a90e-6fd7da241952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08514c8c-f611-482f-8918-fc71acc2380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Volume b55daf5c-b79f-41c9-ba20-ff08895111e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55daf5c-b79f-41c9-ba20-ff08895111e5', 'volume_size': 1} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1857976730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55daf5c-b79f-41c9-ba20-ff08895111e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68460f0d999e468086c0dd7ced0519c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='4923b45ab594483e97e2cddefdf36202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(647f91bc-b7e5-4515-a46e-f686734945b5),volume_type_id=647f91bc-b7e5-4515-a46e-f686734945b5)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Creating volume b55daf5c-b79f-41c9-ba20-ff08895111e5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 1073741824 Sep 23 00:28:02 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a Sep 23 00:28:02 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:02 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 1073741824" returned: 0 in 0.507s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:02 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-178786da-9f92-4c2a-9866-9aa396d1f95a" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-quobyte-178786da-9f92-4c2a-9866-9aa396d1f95a" released by "delete_volume" :: held 0.854s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 Sep 23 00:28:03 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Created reservations ['779b7f5a-7333-47fd-a68f-f620628f8888', '4911528b-641c-4b0f-a08b-aae19f6d58cb', '165c63ea-82e7-4025-a1cc-2cdf456ff615', '9e650fd1-f830-4c8c-8d57-518547bdecb7', 'e3b0d981-3a15-4838-aa13-f927369670e2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:03 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:03 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08514c8c-f611-482f-8918-fc71acc2380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55daf5c-b79f-41c9-ba20-ff08895111e5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd59344-9699-48d3-8ec9-a6a36c7f98b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Volume volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 (b55daf5c-b79f-41c9-ba20-ff08895111e5): created successfully Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd59344-9699-48d3-8ec9-a6a36c7f98b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Flow 'volume_create_manager' (288c01f6-ffa4-4dd6-a74d-81bc88bc8289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3123841b-cdee-430b-ba14-8b44349a6da3 tempest-VolumeTypesAccessTest-1904457262 None] Created volume successfully. Sep 23 00:28:03 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Deleted volume successfully. Sep 23 00:28:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-78187dbf-140a-487e-b995-8ff9dc39f6f1 tempest-VolumesTransfersV355Test-37959179 None] Lock "cinder-178786da-9f92-4c2a-9866-9aa396d1f95a-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Acquiring lock "cinder-b55daf5c-b79f-41c9-ba20-ff08895111e5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "cinder-b55daf5c-b79f-41c9-ba20-ff08895111e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Acquiring lock "cinder-quobyte-b55daf5c-b79f-41c9-ba20-ff08895111e5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "cinder-quobyte-b55daf5c-b79f-41c9-ba20-ff08895111e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1288b9-084c-4c2e-87b2-abc80f554a7a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 Sep 23 00:28:04 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5 Sep 23 00:28:05 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b55daf5c-b79f-41c9-ba20-ff08895111e5" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "cinder-quobyte-b55daf5c-b79f-41c9-ba20-ff08895111e5" released by "delete_volume" :: held 0.795s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:05 devstack cinder-volume[86731]: WARNING cinder.quota [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1889622638 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1889622638, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:28:05 devstack cinder-volume[86731]: WARNING cinder.quota [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1889622638 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1889622638, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Created reservations ['b8d1b1e2-e647-4f2a-a7ed-ebaf32e584dc', '04223267-764f-418c-add4-5468ff1af57d', '8ca9bbbc-a010-4dc9-bc74-7d00cce8eaed', 'fc86f4f6-ddb6-4d59-ad6e-d699011faad9', '4283a0fe-e502-449f-89bd-84a8369c6ccf'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:05 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.337s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Deleted volume successfully. Sep 23 00:28:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f7f6a8b-6784-4980-987f-0135cb1ea61a tempest-VolumeTypesAccessTest-1904457262 None] Lock "cinder-b55daf5c-b79f-41c9-ba20-ff08895111e5-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Flow 'volume_create_manager' (1e7450bd-2a4a-4503-bf16-b344ce98a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb2ab86-3993-43c5-90b6-3f26b5decc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb2ab86-3993-43c5-90b6-3f26b5decc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1203710651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaa77cf-944d-4feb-834c-5b3b91014bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11295c0f95804b11995081a4e0768ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:15Z,use_quota=True,user_id='5121428d3dbd4d47bac20cae48f840ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9863002a-594c-415d-ade2-277af14e2a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9863002a-594c-415d-ade2-277af14e2a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e6fc1-254f-4f46-8b4a-e0916ade57fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e6fc1-254f-4f46-8b4a-e0916ade57fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caaa77cf-944d-4feb-834c-5b3b91014bd5', 'volume_name': 'volume-caaa77cf-944d-4feb-834c-5b3b91014bd5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835a616-79aa-4a47-8913-df84dce272f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835a616-79aa-4a47-8913-df84dce272f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10f7dd-15c1-4891-ba27-4a9df009f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Volume caaa77cf-944d-4feb-834c-5b3b91014bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caaa77cf-944d-4feb-834c-5b3b91014bd5', 'volume_size': 1} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1203710651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caaa77cf-944d-4feb-834c-5b3b91014bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11295c0f95804b11995081a4e0768ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:15Z,use_quota=True,user_id='5121428d3dbd4d47bac20cae48f840ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Creating volume caaa77cf-944d-4feb-834c-5b3b91014bd5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:14 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 1073741824 Sep 23 00:28:14 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 1073741824" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 Sep 23 00:28:15 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10f7dd-15c1-4891-ba27-4a9df009f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caaa77cf-944d-4feb-834c-5b3b91014bd5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf7366-1a92-4e2a-944d-e32a4d9910b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Volume volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 (caaa77cf-944d-4feb-834c-5b3b91014bd5): created successfully Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf7366-1a92-4e2a-944d-e32a4d9910b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Flow 'volume_create_manager' (1e7450bd-2a4a-4503-bf16-b344ce98a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-da1e9034-596f-43d2-b6bd-4a6114ac58f7 tempest-VolumesNegativeTest-834666330 None] Created volume successfully. Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Flow 'volume_create_manager' (f9c028e3-c29f-4a65-a4e7-49a658c71614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abe4421-4b33-4785-afcd-233d4f7d4c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abe4421-4b33-4785-afcd-233d4f7d4c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-130569221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a905f3-b5b1-4e6e-b10a-60876b84be7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53384c51c0f94d449d0506b0a92c7733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:21Z,use_quota=True,user_id='dea2c4b38d284ef7955e836d8cf0905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506845a-2400-44d9-93eb-9b1bfd36eee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506845a-2400-44d9-93eb-9b1bfd36eee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4d5a34-30e7-44fc-95b1-b73ba05e26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4d5a34-30e7-44fc-95b1-b73ba05e26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79a905f3-b5b1-4e6e-b10a-60876b84be7b', 'volume_name': 'volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c525f65-883a-4190-8fa0-7c15b936dddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c525f65-883a-4190-8fa0-7c15b936dddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763fa3ae-4f11-4d4c-87aa-9cbef095263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:28:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Trying to clone 79a905f3-b5b1-4e6e-b10a-60876b84be7b from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:28:22 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e60e87-0a9c-4888-9783-b09f5c5435f8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:22 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD Sep 23 00:28:22 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:22 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 is fetched for user dea2c4b38d284ef7955e836d8cf0905f. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[035612aa-6635-4d7f-b137-c8b933d6b370]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:22 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD Sep 23 00:28:22 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:23 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-130569221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a905f3-b5b1-4e6e-b10a-60876b84be7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53384c51c0f94d449d0506b0a92c7733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:21Z,use_quota=True,user_id='dea2c4b38d284ef7955e836d8cf0905f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Creating volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1073741824 Sep 23 00:28:23 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:23 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1073741824" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:23 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b Sep 23 00:28:23 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:24 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Attempting download of 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b98c48-e65d-402f-9e3c-6b7af29ba099]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs Sep 23 00:28:24 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs" returned: 0 in 0.575s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs Sep 23 00:28:25 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs" returned: 1 in 0.509s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37__5ma0exs' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfed43b3-9eb3-4af7-a38e-d783e1632141]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:25 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD Sep 23 00:28:25 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:26 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] 0372fb84-b9ec-4156-81ef-452ae7f0ea37 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:28:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b Sep 23 00:28:26 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:28 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b" returned: 0 in 2.710s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:28 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_oqax3ziadevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:28 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Converted 112.00 MB image at 41.26 MB/s Sep 23 00:28:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:28 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1G Sep 23 00:28:28 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b 1G" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Downloaded image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 for user dea2c4b38d284ef7955e836d8cf0905f is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Marking volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Copying metadata from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 to 79a905f3-b5b1-4e6e-b10a-60876b84be7b. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Creating volume glance metadata for volume 79a905f3-b5b1-4e6e-b10a-60876b84be7b backed by image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763fa3ae-4f11-4d4c-87aa-9cbef095263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c046ef8c-bd43-44b7-99c8-06b1a2577917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Volume volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b (79a905f3-b5b1-4e6e-b10a-60876b84be7b): created successfully Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c046ef8c-bd43-44b7-99c8-06b1a2577917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Flow 'volume_create_manager' (f9c028e3-c29f-4a65-a4e7-49a658c71614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5bad9805-0eea-4036-b987-62ff8f056e59 tempest-VolumesImageMetadata-137992799 None] Created volume successfully. Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Acquiring lock "cinder-79a905f3-b5b1-4e6e-b10a-60876b84be7b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "cinder-79a905f3-b5b1-4e6e-b10a-60876b84be7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Acquiring lock "cinder-quobyte-79a905f3-b5b1-4e6e-b10a-60876b84be7b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "cinder-quobyte-79a905f3-b5b1-4e6e-b10a-60876b84be7b" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff1f294-019b-46dd-9977-6c93e0a6455a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b Sep 23 00:28:30 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b Sep 23 00:28:31 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-79a905f3-b5b1-4e6e-b10a-60876b84be7b" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "cinder-quobyte-79a905f3-b5b1-4e6e-b10a-60876b84be7b" released by "delete_volume" :: held 0.790s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Created reservations ['3bb76f6e-66f2-4fbb-9d95-a345c6ce6408', '2ed53f3e-e82d-4ac1-82a5-9ca9eb2f8d8a', '44b341c4-19f4-47bb-ab39-17966c2a169b', 'e6cbff7a-8e46-4fcd-a7e5-a2f9fb43833d', '4f90fd55-aa0a-42fd-bfe8-5dcca5cef123'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:31 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Deleted volume successfully. Sep 23 00:28:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aaaa163b-31be-4149-8baa-1d85329ed55d tempest-VolumesImageMetadata-137992799 None] Lock "cinder-79a905f3-b5b1-4e6e-b10a-60876b84be7b-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Flow 'volume_create_manager' (c4902940-5b5e-4be8-8517-bd6bb5b13690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af800d1d-faac-4e68-b2b0-b48952c07bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af800d1d-faac-4e68-b2b0-b48952c07bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-398603174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0f1d77-b642-486c-91f5-daaeefefc6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5926482fe4c2bb76b06e0662fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='a459dd9828ba4385be8f853d9b3264d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28277996-1c36-476f-9b01-95c5772f560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28277996-1c36-476f-9b01-95c5772f560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e119066-854d-48dc-8f91-421e1a0580ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e119066-854d-48dc-8f91-421e1a0580ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0f1d77-b642-486c-91f5-daaeefefc6b6', 'volume_name': 'volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f07b73-313d-49cd-9ef9-72de0b4f41d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f07b73-313d-49cd-9ef9-72de0b4f41d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4dac24-5952-4634-8b93-19ce87642e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Volume cf0f1d77-b642-486c-91f5-daaeefefc6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6', 'volume_size': 1} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-398603174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0f1d77-b642-486c-91f5-daaeefefc6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5926482fe4c2bb76b06e0662fe966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='a459dd9828ba4385be8f853d9b3264d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Creating volume cf0f1d77-b642-486c-91f5-daaeefefc6b6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 1073741824 Sep 23 00:28:36 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 1073741824" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 Sep 23 00:28:37 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:37 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4dac24-5952-4634-8b93-19ce87642e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c2160e-a87b-47de-aa29-1138234f0b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Volume volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 (cf0f1d77-b642-486c-91f5-daaeefefc6b6): created successfully Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c2160e-a87b-47de-aa29-1138234f0b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Flow 'volume_create_manager' (c4902940-5b5e-4be8-8517-bd6bb5b13690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-de9a50f7-a177-4f03-96cf-5f95eb54441e tempest-VolumesMetadataTest-495217254 None] Created volume successfully. Sep 23 00:28:37 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Acquiring lock "cinder-caaa77cf-944d-4feb-834c-5b3b91014bd5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "cinder-caaa77cf-944d-4feb-834c-5b3b91014bd5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Acquiring lock "cinder-quobyte-caaa77cf-944d-4feb-834c-5b3b91014bd5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "cinder-quobyte-caaa77cf-944d-4feb-834c-5b3b91014bd5" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf8ece3-bcce-4574-b029-d0ba41d0153e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 Sep 23 00:28:38 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5 Sep 23 00:28:38 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caaa77cf-944d-4feb-834c-5b3b91014bd5" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "cinder-quobyte-caaa77cf-944d-4feb-834c-5b3b91014bd5" released by "delete_volume" :: held 0.726s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Created reservations ['0d89d684-f3d5-40e5-b7c0-43cdf8560db5', 'ae3ea669-15dc-4865-903b-fa2897e36d6a', 'c8123ada-008a-4757-bdfa-b38347f125ac', 'd1228bb0-0880-4fdb-a234-adf012d4bb5b', 'bc3b59ee-a5f8-41ca-a365-ecad8aff860d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:39 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Acquiring lock "cinder-cf0f1d77-b642-486c-91f5-daaeefefc6b6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "cinder-cf0f1d77-b642-486c-91f5-daaeefefc6b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Acquiring lock "cinder-quobyte-cf0f1d77-b642-486c-91f5-daaeefefc6b6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "cinder-quobyte-cf0f1d77-b642-486c-91f5-daaeefefc6b6" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Deleted volume successfully. Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d9503-2878-4bd7-8295-40f265a7f3dd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ba2a0d8e-97f0-4251-939c-c5354ca14040 tempest-VolumesNegativeTest-834666330 None] Lock "cinder-caaa77cf-944d-4feb-834c-5b3b91014bd5-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:39 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 Sep 23 00:28:39 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6 Sep 23 00:28:40 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-cf0f1d77-b642-486c-91f5-daaeefefc6b6" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "cinder-quobyte-cf0f1d77-b642-486c-91f5-daaeefefc6b6" released by "delete_volume" :: held 0.697s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Created reservations ['e73696f6-934c-41c4-bca0-b236865a2d25', 'ffcfbae3-06a6-4217-9288-871055279e93', '8f8c8262-672d-4cfa-b3b7-ce88bd5060f9', 'ef009237-e7cf-40f2-be94-b7a03bb542dd', '26d9a075-55ca-4dae-befa-fd819e3e2e3a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=89,cinder:INSERT=44,cinder:UPDATE=148,cinder:DELETE=12 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=106,cinder:UPDATE=110,cinder:INSERT=39,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:40 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Deleted volume successfully. Sep 23 00:28:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-838ed4fa-4bc3-4b9f-8f8a-ca6c52d03830 tempest-VolumesMetadataTest-495217254 None] Lock "cinder-cf0f1d77-b642-486c-91f5-daaeefefc6b6-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Flow 'volume_create_manager' (57d2a81c-ab12-4252-9561-ebf5b13504c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047d1ae3-8afa-4621-8aa9-444f97bd3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047d1ae3-8afa-4621-8aa9-444f97bd3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-417234137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1caf64-3bf3-49ac-9316-e141dc952db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1c7fa21e034d67bf3f1e8c90b46789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:45Z,use_quota=True,user_id='7a5a90a5b2b34576a4c11ae414332c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddafb2e-e9a5-4e01-8a22-bb2dc301762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddafb2e-e9a5-4e01-8a22-bb2dc301762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85a58ad-c77f-4fe3-bbd3-6e7a067d2461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85a58ad-c77f-4fe3-bbd3-6e7a067d2461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1caf64-3bf3-49ac-9316-e141dc952db2', 'volume_name': 'volume-5e1caf64-3bf3-49ac-9316-e141dc952db2', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8c9ef-b482-487d-a126-e13ffc96afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d8c9ef-b482-487d-a126-e13ffc96afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b464e329-8661-408d-9593-85adaa8d8125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Volume 5e1caf64-3bf3-49ac-9316-e141dc952db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1caf64-3bf3-49ac-9316-e141dc952db2', 'volume_size': 2} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-417234137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1caf64-3bf3-49ac-9316-e141dc952db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1c7fa21e034d67bf3f1e8c90b46789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:45Z,use_quota=True,user_id='7a5a90a5b2b34576a4c11ae414332c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Creating volume 5e1caf64-3bf3-49ac-9316-e141dc952db2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 2147483648 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 2147483648 Sep 23 00:28:45 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 2147483648" returned: 0 in 0.613s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 Sep 23 00:28:46 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b464e329-8661-408d-9593-85adaa8d8125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1caf64-3bf3-49ac-9316-e141dc952db2', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df42f05-9903-4756-a427-b86bac2b48a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Volume volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 (5e1caf64-3bf3-49ac-9316-e141dc952db2): created successfully Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df42f05-9903-4756-a427-b86bac2b48a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Flow 'volume_create_manager' (57d2a81c-ab12-4252-9561-ebf5b13504c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-646c36a4-61bd-4207-bad7-8b8057cf54d1 tempest-VolumesCloneNegativeTest-992377454 None] Created volume successfully. Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Acquiring lock "cinder-5e1caf64-3bf3-49ac-9316-e141dc952db2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "cinder-5e1caf64-3bf3-49ac-9316-e141dc952db2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Acquiring lock "cinder-quobyte-5e1caf64-3bf3-49ac-9316-e141dc952db2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "cinder-quobyte-5e1caf64-3bf3-49ac-9316-e141dc952db2" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ce959-debe-4d50-80f3-cf2413af6c3b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 Sep 23 00:28:47 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2" returned: 0 in 0.565s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2 Sep 23 00:28:48 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5e1caf64-3bf3-49ac-9316-e141dc952db2" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "cinder-quobyte-5e1caf64-3bf3-49ac-9316-e141dc952db2" released by "delete_volume" :: held 0.939s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Created reservations ['ab32c690-0b55-44af-891c-1a7d6427311b', '0f18a322-8ef5-404f-a10e-64d3a1fb356e', '8633e019-c36b-410b-bde4-6acf5e7b9bc4', 'f9167130-8fcc-4801-98ba-45bb720354a9', '64245efd-306f-4e04-bc28-b490a724101b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:28:48 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:49 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Deleted volume successfully. Sep 23 00:28:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3d40ccdb-f169-4ef4-93bf-0f16fb09b69a tempest-VolumesCloneNegativeTest-992377454 None] Lock "cinder-5e1caf64-3bf3-49ac-9316-e141dc952db2-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Flow 'volume_create_manager' (65aa8f5a-cfe2-4822-a676-54dcdda0fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290a1c06-aa01-4ffa-b27c-54d9f65a9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290a1c06-aa01-4ffa-b27c-54d9f65a9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1585274058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2000d72f-029c-4014-8636-6f9c07aa3691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9287212451415595ae47505b8cdb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:57Z,use_quota=True,user_id='451a05c87beb453686b00ca7ad888f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529d9613-55d0-4876-a57b-57d9fd1bd9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529d9613-55d0-4876-a57b-57d9fd1bd9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c444c1-ec61-4e7e-829b-4e7acd82e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c444c1-ec61-4e7e-829b-4e7acd82e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2000d72f-029c-4014-8636-6f9c07aa3691', 'volume_name': 'volume-2000d72f-029c-4014-8636-6f9c07aa3691', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22254b86-48a2-4d63-9496-6425df8eeeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22254b86-48a2-4d63-9496-6425df8eeeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edf9b7-38e9-4f01-b06c-5bb9eaf948f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Volume 2000d72f-029c-4014-8636-6f9c07aa3691: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2000d72f-029c-4014-8636-6f9c07aa3691', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:28:56 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Trying to clone 2000d72f-029c-4014-8636-6f9c07aa3691 from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:28:57 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:28:57 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:28:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2239008b-3914-4a4d-8ac8-9a0869aed6b2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:57 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD Sep 23 00:28:57 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:57 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:57 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 is fetched for user 451a05c87beb453686b00ca7ad888f22. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b5333-b9ae-4c5f-ae9b-8aa518034102]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:58 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD Sep 23 00:28:58 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:58 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1585274058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2000d72f-029c-4014-8636-6f9c07aa3691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9287212451415595ae47505b8cdb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:57Z,use_quota=True,user_id='451a05c87beb453686b00ca7ad888f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Creating volume 2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:28:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:58 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1073741824 Sep 23 00:28:58 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:59 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1073741824" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:59 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 Sep 23 00:28:59 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:59 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Attempting download of 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 2000d72f-029c-4014-8636-6f9c07aa3691. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ffbfc9-4a9f-4ba3-9f12-f397703942ba]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:59 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021 Sep 23 00:28:59 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:59 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021 Sep 23 00:29:00 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:00 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021" returned: 1 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_q5fby021' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa680497-2c7d-49e5-b375-f290540cd319]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD Sep 23 00:29:00 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:00 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] 0372fb84-b9ec-4156-81ef-452ae7f0ea37 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:29:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:00 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 Sep 23 00:29:00 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691" returned: 0 in 2.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_6if_l4pudevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:03 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Converted 112.00 MB image at 42.84 MB/s Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:03 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1G Sep 23 00:29:03 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 1G" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Downloaded image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 2000d72f-029c-4014-8636-6f9c07aa3691 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 for user 451a05c87beb453686b00ca7ad888f22 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Marking volume 2000d72f-029c-4014-8636-6f9c07aa3691 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Copying metadata from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 to 2000d72f-029c-4014-8636-6f9c07aa3691. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Creating volume glance metadata for volume 2000d72f-029c-4014-8636-6f9c07aa3691 backed by image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:29:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42edf9b7-38e9-4f01-b06c-5bb9eaf948f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2000d72f-029c-4014-8636-6f9c07aa3691', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c1bdf9-b0d3-466e-91c8-24861873b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Volume volume-2000d72f-029c-4014-8636-6f9c07aa3691 (2000d72f-029c-4014-8636-6f9c07aa3691): created successfully Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c1bdf9-b0d3-466e-91c8-24861873b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Flow 'volume_create_manager' (65aa8f5a-cfe2-4822-a676-54dcdda0fee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a6758f02-0a55-4aca-aab3-598eb3cafb00 tempest-VolumesExtendTest-138145195 None] Created volume successfully. Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408ada5-eb1c-40f0-a5b6-f1125a9a6768]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 Sep 23 00:29:04 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:04 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 2G" returned: 0 in 0.118s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.601s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eb61977e-0433-4d29-93bd-6b83a761b7a2 tempest-VolumesExtendTest-138145195 None] Extend volume completed successfully. Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-2000d72f-029c-4014-8636-6f9c07aa3691-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "cinder-2000d72f-029c-4014-8636-6f9c07aa3691-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-quobyte-2000d72f-029c-4014-8636-6f9c07aa3691" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-2000d72f-029c-4014-8636-6f9c07aa3691" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d425c6-e425-41eb-be60-5f83f7e689cd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 Sep 23 00:29:06 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691 Sep 23 00:29:06 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2000d72f-029c-4014-8636-6f9c07aa3691" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-2000d72f-029c-4014-8636-6f9c07aa3691" released by "delete_volume" :: held 0.806s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Created reservations ['7b68941b-8c5c-45e5-91f6-cc094cec2a85', 'ee714f02-c8f8-476b-9cea-6f486be28336', 'a22a3ee4-9568-47ce-a17e-91b25ef58e82', '945136c0-fcab-4d4c-9103-621e9481b272', '5eb64a85-283d-4735-b370-71b15e131e52'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:07 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:07 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Deleted volume successfully. Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-601a453c-a1a7-44fb-931f-4f1bdd2118ce tempest-VolumesExtendTest-138145195 None] Lock "cinder-2000d72f-029c-4014-8636-6f9c07aa3691-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Flow 'volume_create_manager' (aa93985d-8dab-4506-a83a-d07038b03656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b0806-ae4f-45bc-a412-21b583b97531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05b0806-ae4f-45bc-a412-21b583b97531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-20408485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b870f92c-6bd5-46db-873b-c08b578a4ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9287212451415595ae47505b8cdb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:08Z,use_quota=True,user_id='451a05c87beb453686b00ca7ad888f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d805f4-f627-49e2-b5ad-502b2025a04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d805f4-f627-49e2-b5ad-502b2025a04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23b1264-ca51-4b6d-b77a-19f8ee0e179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23b1264-ca51-4b6d-b77a-19f8ee0e179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b870f92c-6bd5-46db-873b-c08b578a4ad8', 'volume_name': 'volume-b870f92c-6bd5-46db-873b-c08b578a4ad8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08331a4-a5ff-4807-b613-7d047d474366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08331a4-a5ff-4807-b613-7d047d474366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a2a7a-391a-4476-adb0-de3f746177a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Volume b870f92c-6bd5-46db-873b-c08b578a4ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b870f92c-6bd5-46db-873b-c08b578a4ad8', 'volume_size': 1} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-20408485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b870f92c-6bd5-46db-873b-c08b578a4ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be9287212451415595ae47505b8cdb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:08Z,use_quota=True,user_id='451a05c87beb453686b00ca7ad888f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Creating volume b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:07 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 1073741824 Sep 23 00:29:07 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 1073741824" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:08 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.297s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a2a7a-391a-4476-adb0-de3f746177a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b870f92c-6bd5-46db-873b-c08b578a4ad8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76eb037f-6997-4e89-a168-6a13aab01f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Volume volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 (b870f92c-6bd5-46db-873b-c08b578a4ad8): created successfully Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76eb037f-6997-4e89-a168-6a13aab01f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Flow 'volume_create_manager' (aa93985d-8dab-4506-a83a-d07038b03656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-87b66aaa-96fa-4660-896f-785b04646b8b tempest-VolumesExtendTest-138145195 None] Created volume successfully. Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Creating offline snapshot 154f6536-107e-4a15-a2f9-43536e2d88e8 of volume b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[41621b43-dab8-4464-b4c3-5b5df677581a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:10 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 1G Sep 23 00:29:10 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 1G" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 Sep 23 00:29:11 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 is being set with open permissions: ugo+rw Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 Sep 23 00:29:11 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info Sep 23 00:29:11 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:12 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:12 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info is being set with open permissions: ugo+rw Sep 23 00:29:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:12 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info Sep 23 00:29:12 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:12 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.info" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4abc0a7c-b109-4b4d-ae2d-adf99eeebbc2 tempest-VolumesExtendTest-138145195 None] Create snapshot completed successfully Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc54f4-e6e6-4e7c-9a66-bf86ca512e59]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:13 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:13 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:13 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 2G" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.977s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-18b5fae8-8427-49f2-9489-a968e38c31dc tempest-VolumesExtendTest-138145195 None] Extend volume completed successfully. Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-154f6536-107e-4a15-a2f9-43536e2d88e8-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-154f6536-107e-4a15-a2f9-43536e2d88e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-quobyte-154f6536-107e-4a15-a2f9-43536e2d88e8" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-154f6536-107e-4a15-a2f9-43536e2d88e8" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Deleting offline snapshot 154f6536-107e-4a15-a2f9-43536e2d88e8 of volume b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] snapshot_file for this snap is: volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d866c29-cc0d-4f16-ab52-53ce610e09ab]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 Sep 23 00:29:16 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b870f92c-6bd5-46db-873b-c08b578a4ad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef270c7-791b-4bf3-9a90-f730df218d80]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:16 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:16 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:16 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 Sep 23 00:29:16 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:17 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:17 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8 Sep 23 00:29:17 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:17 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8.154f6536-107e-4a15-a2f9-43536e2d88e8" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-154f6536-107e-4a15-a2f9-43536e2d88e8" released by "_delete_snapshot" :: held 2.068s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" released by "delete_snapshot" :: held 2.118s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:18 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Created reservations ['e294416b-ce64-4799-b45d-5166d18559d3', 'f1d04ebf-3829-46b0-be7e-99ac435251b1', '6b74a7dd-714d-40b6-bbcb-3c12b480d065', '484b9fd5-f348-418b-a389-957e77dc5542', 'bc151f53-75b2-4095-b66a-e7fc83f315ef'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Delete snapshot completed successfully. Sep 23 00:29:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ff1f4e65-2ba7-47dd-98f5-87315536112e tempest-VolumesExtendTest-138145195 None] Lock "cinder-154f6536-107e-4a15-a2f9-43536e2d88e8-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-b870f92c-6bd5-46db-873b-c08b578a4ad8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "cinder-b870f92c-6bd5-46db-873b-c08b578a4ad8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Acquiring lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8ef57-6253-4f7f-9014-546b7688ec8e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:19 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:19 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8 Sep 23 00:29:19 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:19 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b870f92c-6bd5-46db-873b-c08b578a4ad8" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "cinder-quobyte-b870f92c-6bd5-46db-873b-c08b578a4ad8" released by "delete_volume" :: held 0.718s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Created reservations ['24f966b5-e715-4d02-947c-a1d4b63dad36', 'c8e5a408-f137-4d1f-9595-86004fa3dbf2', 'd883fce9-7a06-4d72-80fb-bc8e5973f7d4', 'bc39395b-f79d-432b-bee2-d5afba3b4b3f', '6ceb415f-7453-4bc8-b71a-ae4acec16bea'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:20 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:20 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:20 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Deleted volume successfully. Sep 23 00:29:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4f463810-5c4a-48e3-8e77-d6c421b9f45f tempest-VolumesExtendTest-138145195 None] Lock "cinder-b870f92c-6bd5-46db-873b-c08b578a4ad8-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (9f36d2d0-8b07-4d3b-b99d-15f1e935b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9550fcbc-e62e-495d-bffa-ce464b332a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9550fcbc-e62e-495d-bffa-ce464b332a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1162854507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768651d0-0fed-41be-b7ef-f41ecf570efd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:25Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f855fa5-6b3c-4787-9ba6-dded272e428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f855fa5-6b3c-4787-9ba6-dded272e428e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40765af-c9d4-427f-84ce-5a189b1121a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40765af-c9d4-427f-84ce-5a189b1121a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768651d0-0fed-41be-b7ef-f41ecf570efd', 'volume_name': 'volume-768651d0-0fed-41be-b7ef-f41ecf570efd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64861497-02e3-4a6f-812e-c62f9682ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64861497-02e3-4a6f-812e-c62f9682ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d95e99-62a0-4f3d-8d25-db1a8451db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Volume 768651d0-0fed-41be-b7ef-f41ecf570efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768651d0-0fed-41be-b7ef-f41ecf570efd', 'volume_size': 1} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1162854507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768651d0-0fed-41be-b7ef-f41ecf570efd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:25Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Creating volume 768651d0-0fed-41be-b7ef-f41ecf570efd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:25 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:25 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd 1073741824 Sep 23 00:29:25 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd 1073741824" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd Sep 23 00:29:26 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:26 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d95e99-62a0-4f3d-8d25-db1a8451db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768651d0-0fed-41be-b7ef-f41ecf570efd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86895a-fbc5-4bef-8afd-c4148f38b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Volume volume-768651d0-0fed-41be-b7ef-f41ecf570efd (768651d0-0fed-41be-b7ef-f41ecf570efd): created successfully Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86895a-fbc5-4bef-8afd-c4148f38b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (9f36d2d0-8b07-4d3b-b99d-15f1e935b25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-713db9dd-8f62-4cf4-b131-6c3406a64fcb tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (cb333853-70c2-4081-9130-0c5d4722378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578b2d57-5233-4d22-aeff-60dbf924102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578b2d57-5233-4d22-aeff-60dbf924102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-630426370',display_name='tempest-VolumesGetTest-Volume-1909705508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092f417b-6db8-421f-9ad3-d396bbf26400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:28Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ddfc1-dc34-486c-a5d4-85a18d55f099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ddfc1-dc34-486c-a5d4-85a18d55f099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0692f0-93b5-4dce-a7d1-4787add72613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0692f0-93b5-4dce-a7d1-4787add72613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092f417b-6db8-421f-9ad3-d396bbf26400', 'volume_name': 'volume-092f417b-6db8-421f-9ad3-d396bbf26400', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9d358e-a27b-4ea4-ba7f-f076faea3d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9d358e-a27b-4ea4-ba7f-f076faea3d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22abe9c1-6944-411e-8c11-bba710acd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Volume 092f417b-6db8-421f-9ad3-d396bbf26400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092f417b-6db8-421f-9ad3-d396bbf26400', 'volume_size': 1} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-630426370',display_name='tempest-VolumesGetTest-Volume-1909705508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092f417b-6db8-421f-9ad3-d396bbf26400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:28Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Creating volume 092f417b-6db8-421f-9ad3-d396bbf26400 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:28 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 1073741824 Sep 23 00:29:28 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 1073741824" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:28 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 Sep 23 00:29:28 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22abe9c1-6944-411e-8c11-bba710acd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092f417b-6db8-421f-9ad3-d396bbf26400', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513799eb-6241-4957-b478-e887859e5ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Volume volume-092f417b-6db8-421f-9ad3-d396bbf26400 (092f417b-6db8-421f-9ad3-d396bbf26400): created successfully Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513799eb-6241-4957-b478-e887859e5ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (cb333853-70c2-4081-9130-0c5d4722378e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-19cf3af0-e4fb-45d0-8cf7-cb42cb9966a5 tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-092f417b-6db8-421f-9ad3-d396bbf26400-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "cinder-092f417b-6db8-421f-9ad3-d396bbf26400-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-092f417b-6db8-421f-9ad3-d396bbf26400" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-092f417b-6db8-421f-9ad3-d396bbf26400" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f7c591-1491-451e-aa0c-80c1df1a7329]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 Sep 23 00:29:29 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:29 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400" returned: 0 in 0.365s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:29 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400 Sep 23 00:29:29 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-092f417b-6db8-421f-9ad3-d396bbf26400" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-092f417b-6db8-421f-9ad3-d396bbf26400" released by "delete_volume" :: held 0.650s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Created reservations ['54d05176-2456-41fb-b8ab-4d069e64b5cb', '96812f9b-c810-4823-b5f8-09e6f7636b73', 'e0d44b21-9315-4c64-9937-afb1b595d9b7', '618ca6c4-586a-4117-8177-364845a6f2ef', 'fd6e587e-4050-4110-ac39-97169d02a6e2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:30 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:30 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fcb59837-393c-4d49-bf63-19af6a7c52dd tempest-VolumesGetTest-187652521 None] Lock "cinder-092f417b-6db8-421f-9ad3-d396bbf26400-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-768651d0-0fed-41be-b7ef-f41ecf570efd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "cinder-768651d0-0fed-41be-b7ef-f41ecf570efd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-768651d0-0fed-41be-b7ef-f41ecf570efd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-768651d0-0fed-41be-b7ef-f41ecf570efd" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698985c-c8f2-4541-97e2-7b54e74f84d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:30 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd Sep 23 00:29:30 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:31 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd Sep 23 00:29:31 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-768651d0-0fed-41be-b7ef-f41ecf570efd" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-768651d0-0fed-41be-b7ef-f41ecf570efd" released by "delete_volume" :: held 0.666s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Created reservations ['8c9989b2-d894-4db2-9a93-e3a100470a45', 'bf10f075-24cf-43c6-be5c-52c0e01d797f', 'b2381dae-84d5-4548-a5c7-affb76ecdd5c', '1d4edd34-2cfc-4373-bf0b-976d07ee6758', '38466928-f4d9-4361-84fe-13bc3e4213a8'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:31 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:31 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:31 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:29:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-66fd5497-76be-4d42-8ff5-e7835b36e9e8 tempest-VolumesGetTest-187652521 None] Lock "cinder-768651d0-0fed-41be-b7ef-f41ecf570efd-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (c7f7d080-8103-43df-bac2-bb913a691d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50b596b-8048-402f-ad0b-0a51678e6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50b596b-8048-402f-ad0b-0a51678e6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-272333606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be0516-09bb-41a6-83a8-472f86dd809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:32Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253e5ac-adbe-4d44-a708-b189bac5aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253e5ac-adbe-4d44-a708-b189bac5aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6cdbdb-f19f-4429-bc65-063adfafb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6cdbdb-f19f-4429-bc65-063adfafb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46be0516-09bb-41a6-83a8-472f86dd809f', 'volume_name': 'volume-46be0516-09bb-41a6-83a8-472f86dd809f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d37a6e-c387-4107-91da-ce11ca7e61c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d37a6e-c387-4107-91da-ce11ca7e61c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395665d-2bfc-45e6-a803-4c5ed916ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Volume 46be0516-09bb-41a6-83a8-472f86dd809f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46be0516-09bb-41a6-83a8-472f86dd809f', 'volume_size': 1} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-272333606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be0516-09bb-41a6-83a8-472f86dd809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:32Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Creating volume 46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:32 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f 1073741824 Sep 23 00:29:32 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:32 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f 1073741824" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:32 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:32 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:33 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395665d-2bfc-45e6-a803-4c5ed916ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46be0516-09bb-41a6-83a8-472f86dd809f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83d0081-6d88-4a1d-aae6-ce45dd7c22f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Volume volume-46be0516-09bb-41a6-83a8-472f86dd809f (46be0516-09bb-41a6-83a8-472f86dd809f): created successfully Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83d0081-6d88-4a1d-aae6-ce45dd7c22f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (c7f7d080-8103-43df-bac2-bb913a691d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b3011097-3678-4820-b195-d26267e801bd tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (67371983-fa5b-41e8-a20a-562fb254c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47646556-c4a4-4f7d-94b0-a7088164e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47646556-c4a4-4f7d-94b0-a7088164e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-727561287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2c40f2-61bb-401c-8399-93f2eb1ee420,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=46be0516-09bb-41a6-83a8-472f86dd809f,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:34Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7806ce05-ab86-4cc2-814f-286b367d7b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7806ce05-ab86-4cc2-814f-286b367d7b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314cab79-e400-43e9-ab43-aa0c16cc32de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314cab79-e400-43e9-ab43-aa0c16cc32de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d2c40f2-61bb-401c-8399-93f2eb1ee420', 'volume_name': 'volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420', 'volume_size': 1, 'source_volid': '46be0516-09bb-41a6-83a8-472f86dd809f', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5886bb7b-1cb7-4511-a264-3747e6f94282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5886bb7b-1cb7-4511-a264-3747e6f94282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60c8ba-6399-48aa-a31c-758b84bc30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Volume 5d2c40f2-61bb-401c-8399-93f2eb1ee420: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420', 'volume_size': 1, 'source_volid': '46be0516-09bb-41a6-83a8-472f86dd809f', 'source_volstatus': 'available'} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Cloning volume 46be0516-09bb-41a6-83a8-472f86dd809f to volume 5d2c40f2-61bb-401c-8399-93f2eb1ee420 Sep 23 00:29:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Creating offline snapshot ab10e47a-9009-45da-8ccb-ff54f87ee8ee of volume 46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cb510e-85c4-48b4-af15-9108d3497947]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:34 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee 1G Sep 23 00:29:34 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee 1G" returned: 0 in 0.599s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be0516-09bb-41a6-83a8-472f86dd809f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be0516-09bb-41a6-83a8-472f86dd809f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:35 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46be0516-09bb-41a6-83a8-472f86dd809f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee is being set with open permissions: ugo+rw Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:35 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info Sep 23 00:29:35 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info is being set with open permissions: ugo+rw Sep 23 00:29:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info Sep 23 00:29:36 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:36 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.info" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] snapshot: ab10e47a-9009-45da-8ccb-ff54f87ee8ee, volume: 5d2c40f2-61bb-401c-8399-93f2eb1ee420, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff9c8e8-9b3c-4eb3-a96f-be083302ab24]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:36 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:36 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46be0516-09bb-41a6-83a8-472f86dd809f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59b3c0-92e4-4a43-bcfb-6e0d7098cbb2]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:36 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 Sep 23 00:29:37 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:37 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:37 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Flow 'volume_create_manager' (3ff34f84-a0ea-4b0f-be67-4346eeddf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787e8c91-2952-4cd8-86f8-4e5970fdf150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787e8c91-2952-4cd8-86f8-4e5970fdf150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2078187117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d466d4-5427-42c6-b94f-82ccb8dfaffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c822878a79c42d1aa4d9bf9ecde0d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:39Z,use_quota=True,user_id='941f5641040f4c8aa61a15f65bc68dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137a4491-af0d-4ff6-9d7c-b83ecdacebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137a4491-af0d-4ff6-9d7c-b83ecdacebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82200aee-57cf-4332-8985-dc9e9abbc51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82200aee-57cf-4332-8985-dc9e9abbc51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d466d4-5427-42c6-b94f-82ccb8dfaffd', 'volume_name': 'volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9cfcd7-4c43-4d78-a77e-8a6a9d5ab121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9cfcd7-4c43-4d78-a77e-8a6a9d5ab121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50c7672-6946-4add-8e6f-647d4c7c9376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Volume 17d466d4-5427-42c6-b94f-82ccb8dfaffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd', 'volume_size': 1} Sep 23 00:29:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:43 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420" returned: 0 in 6.685s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:43 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:43 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Converted 1024.00 MB image at 153.16 MB/s Sep 23 00:29:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 is being set with open permissions: ugo+rw Sep 23 00:29:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:44 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 Sep 23 00:29:44 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:44 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" released by "_copy_volume_from_snapshot" :: held 7.936s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=89,cinder:DELETE=6,cinder:SELECT=68,cinder:INSERT=27 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-ab10e47a-9009-45da-8ccb-ff54f87ee8ee" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-ab10e47a-9009-45da-8ccb-ff54f87ee8ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Deleting offline snapshot ab10e47a-9009-45da-8ccb-ff54f87ee8ee of volume 46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] snapshot_file for this snap is: volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d387c514-3a0a-4627-9699-f7181a13d162]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:44 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:44 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:44 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46be0516-09bb-41a6-83a8-472f86dd809f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb3ed2-d323-4056-b89d-00e4c6a41ecc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:44 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:44 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:45 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.582s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:45 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:45 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee Sep 23 00:29:45 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f.ab10e47a-9009-45da-8ccb-ff54f87ee8ee" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-ab10e47a-9009-45da-8ccb-ff54f87ee8ee" released by "_delete_snapshot" :: held 1.752s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=88,cinder:SELECT=73,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.159s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.870s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2078187117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d466d4-5427-42c6-b94f-82ccb8dfaffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c822878a79c42d1aa4d9bf9ecde0d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:39Z,use_quota=True,user_id='941f5641040f4c8aa61a15f65bc68dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Creating volume 17d466d4-5427-42c6-b94f-82ccb8dfaffd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:46 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd 1073741824 Sep 23 00:29:46 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60c8ba-6399-48aa-a31c-758b84bc30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420', 'volume_size': 1, 'source_volid': '46be0516-09bb-41a6-83a8-472f86dd809f', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23362ca0-dd92-4093-a7a1-324f90e023fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Volume volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 (5d2c40f2-61bb-401c-8399-93f2eb1ee420): created successfully Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23362ca0-dd92-4093-a7a1-324f90e023fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (67371983-fa5b-41e8-a20a-562fb254c54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-866b55d2-e41f-42a5-8b55-1a6a1d82ba0f tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:29:46 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd 1073741824" returned: 0 in 0.537s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:46 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd Sep 23 00:29:46 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50c7672-6946-4add-8e6f-647d4c7c9376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee9f5d4-6236-46d0-926d-16a5699ac2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Volume volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd (17d466d4-5427-42c6-b94f-82ccb8dfaffd): created successfully Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee9f5d4-6236-46d0-926d-16a5699ac2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Flow 'volume_create_manager' (3ff34f84-a0ea-4b0f-be67-4346eeddf903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-56766c34-d0fd-4879-8f14-580e4bde5e97 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Created volume successfully. Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (c9628be1-bd93-4060-8475-65ba69d2ec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90aa1be-0c1d-41a6-812b-5dab90c37d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90aa1be-0c1d-41a6-812b-5dab90c37d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-205715221',display_name='tempest-VolumesGetTest-Volume-473418704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ac89d3-e62c-43be-9ee1-9dcc05803ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:48Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324586b0-3dad-4c5d-bdc2-80ae3dd09d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324586b0-3dad-4c5d-bdc2-80ae3dd09d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eb13c0-1f7e-497b-b19a-c8511b4e05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eb13c0-1f7e-497b-b19a-c8511b4e05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ac89d3-e62c-43be-9ee1-9dcc05803ec6', 'volume_name': 'volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3aca2-409a-4fe1-bbd3-86694ba6e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3aca2-409a-4fe1-bbd3-86694ba6e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f083d9-5450-43ad-bce9-29b2e77f03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Volume 12ac89d3-e62c-43be-9ee1-9dcc05803ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6', 'volume_size': 1} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-205715221',display_name='tempest-VolumesGetTest-Volume-473418704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ac89d3-e62c-43be-9ee1-9dcc05803ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:48Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Creating volume 12ac89d3-e62c-43be-9ee1-9dcc05803ec6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:48 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 1073741824 Sep 23 00:29:48 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 1073741824" returned: 0 in 0.623s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:48 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 Sep 23 00:29:48 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d9149eb0-246f-40e7-b0c8-7dc6fc9f3124 req-ade784d6-405c-4e78-8ac0-d1cd64d33098 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:49 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d9149eb0-246f-40e7-b0c8-7dc6fc9f3124 req-ade784d6-405c-4e78-8ac0-d1cd64d33098 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.130s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f083d9-5450-43ad-bce9-29b2e77f03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a82a0fd-9549-4976-9550-25a0554042cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d9149eb0-246f-40e7-b0c8-7dc6fc9f3124 req-ade784d6-405c-4e78-8ac0-d1cd64d33098 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Volume volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 (12ac89d3-e62c-43be-9ee1-9dcc05803ec6): created successfully Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a82a0fd-9549-4976-9550-25a0554042cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (c9628be1-bd93-4060-8475-65ba69d2ec97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-34bb0023-1000-445b-be5a-69f09419a149 tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:29:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d9149eb0-246f-40e7-b0c8-7dc6fc9f3124 req-ade784d6-405c-4e78-8ac0-d1cd64d33098 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '919229a0-20b0-4818-88fe-5d3f6d4a9fa8', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d9149eb0-246f-40e7-b0c8-7dc6fc9f3124 req-ade784d6-405c-4e78-8ac0-d1cd64d33098 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] attachment_update completed successfully. Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-12ac89d3-e62c-43be-9ee1-9dcc05803ec6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "cinder-12ac89d3-e62c-43be-9ee1-9dcc05803ec6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e88793-e727-4304-8784-0df51311d51a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 Sep 23 00:29:50 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6 Sep 23 00:29:50 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-12ac89d3-e62c-43be-9ee1-9dcc05803ec6" released by "delete_volume" :: held 0.878s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Created reservations ['f9392101-7134-437a-9349-25b61704d837', 'de36d008-cb59-4a25-b7fd-805fc77f3ce7', '60172e0e-ba78-4e7e-ae18-a0d243da43de', '9760a243-2cd0-40b2-ab5c-3aa42c8c7824', '89d72e50-6090-492e-9908-cfcbf0ad4225'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:51 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-5d2c40f2-61bb-401c-8399-93f2eb1ee420-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "cinder-5d2c40f2-61bb-401c-8399-93f2eb1ee420-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b1984-d9b7-4da9-a75b-26e162eeef0d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:29:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cd143fbc-512a-41a4-a699-9fc3555dcfd8 tempest-VolumesGetTest-187652521 None] Lock "cinder-12ac89d3-e62c-43be-9ee1-9dcc05803ec6-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:51 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 Sep 23 00:29:51 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:52 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420 Sep 23 00:29:52 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5d2c40f2-61bb-401c-8399-93f2eb1ee420" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-5d2c40f2-61bb-401c-8399-93f2eb1ee420" released by "delete_volume" :: held 0.768s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Created reservations ['830da46b-32c2-4291-a681-3af3d95735b8', '03d0f07a-a3a2-4366-943d-5ce52022802f', 'ab33b4f6-ad47-4e93-9464-24588bdc58ce', 'e08f582d-2c15-45fd-85d3-a4c0ec600dda', 'd1a8e8fc-e5b4-43a6-b375-4cae703850c9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:52 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:52 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-f8c420e1-817d-4b63-b630-7975e58c5ea4 req-23139a12-61a3-4535-b77b-ebb37a36fd82 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Terminate volume connection completed successfully. Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-f8c420e1-817d-4b63-b630-7975e58c5ea4 req-23139a12-61a3-4535-b77b-ebb37a36fd82 tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Deleting attachment 919229a0-20b0-4818-88fe-5d3f6d4a9fa8. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:52 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-46be0516-09bb-41a6-83a8-472f86dd809f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "cinder-46be0516-09bb-41a6-83a8-472f86dd809f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c493d204-df29-4c58-8bdf-c218b9891e49 tempest-VolumesGetTest-187652521 None] Lock "cinder-5d2c40f2-61bb-401c-8399-93f2eb1ee420-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-46be0516-09bb-41a6-83a8-472f86dd809f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-46be0516-09bb-41a6-83a8-472f86dd809f" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[707065f3-e1fa-4122-ac44-dc5c47c7a522]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:53 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f Sep 23 00:29:53 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "cinder-17d466d4-5427-42c6-b94f-82ccb8dfaffd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "cinder-17d466d4-5427-42c6-b94f-82ccb8dfaffd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "cinder-quobyte-17d466d4-5427-42c6-b94f-82ccb8dfaffd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "cinder-quobyte-17d466d4-5427-42c6-b94f-82ccb8dfaffd" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e21fb3a-fb19-454f-9076-f86d93406446]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46be0516-09bb-41a6-83a8-472f86dd809f" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-46be0516-09bb-41a6-83a8-472f86dd809f" released by "delete_volume" :: held 0.787s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Created reservations ['9b480ea5-c7ee-4fc8-bf11-d615a2dd375a', 'd0163452-6a65-4fc1-9ac7-b48923c5b48f', 'a880bc5c-8ee2-436e-a01e-b7372faf9ab0', '937ec090-965a-422f-b710-2c0d1509d62f', '83d63345-6b13-433b-9779-2f4ddb29166b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:53 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd Sep 23 00:29:53 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:53 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd Sep 23 00:29:54 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f965b091-8410-4350-85fa-116e43bf1ffd tempest-VolumesGetTest-187652521 None] Lock "cinder-46be0516-09bb-41a6-83a8-472f86dd809f-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:54 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-17d466d4-5427-42c6-b94f-82ccb8dfaffd" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "cinder-quobyte-17d466d4-5427-42c6-b94f-82ccb8dfaffd" released by "delete_volume" :: held 0.775s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Created reservations ['2dfa850e-3f09-4995-ba95-8687164ab155', 'b2093717-f6cb-4536-95c8-0a864bea3741', 'd6252c9c-51d2-4ca3-9294-e2643bbcdbbb', 'a843d73e-5901-4e07-b2a0-e3dc771ab5cb', '19af2eee-9a55-47e1-9506-5eaab23e20b3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:29:54 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Deleted volume successfully. Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-803238f8-35fc-45fd-a32d-d55b06d8b26e tempest-TestServerVolumeAttachScenarioOldVersion-1772883805 None] Lock "cinder-17d466d4-5427-42c6-b94f-82ccb8dfaffd-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (a8293a0d-8524-4225-8e33-14a2d00ee01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a4b72f-f151-4132-92e0-d31ada9913ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a4b72f-f151-4132-92e0-d31ada9913ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-311105514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e2f0d-e2f1-4dd9-90af-46ccbc0e209c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:55Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be50331d-b8af-4ca2-8a38-763d58403176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be50331d-b8af-4ca2-8a38-763d58403176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143da3b6-a9c1-4c5e-af53-cd71589f5b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143da3b6-a9c1-4c5e-af53-cd71589f5b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '871e2f0d-e2f1-4dd9-90af-46ccbc0e209c', 'volume_name': 'volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108642af-6ff7-4711-9424-26c9ca5e3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108642af-6ff7-4711-9424-26c9ca5e3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09acfb30-b731-4963-b748-a3e0834d1fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:29:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Trying to clone 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:29:56 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3ae9f-64e8-48bd-9d36-e30c04541228]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:56 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD Sep 23 00:29:56 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 is fetched for user d4abdfc392674b44ad95c2293b8d095b. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28995b7-0051-49d0-9baa-b28849e43969]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD Sep 23 00:29:57 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:57 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-311105514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871e2f0d-e2f1-4dd9-90af-46ccbc0e209c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:55Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Creating volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1073741824 Sep 23 00:29:57 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:57 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1073741824" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c Sep 23 00:29:57 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:58 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Attempting download of 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75c7f4d-8726-43f4-8284-968b6fc03140]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:58 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez Sep 23 00:29:58 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:58 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:58 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez Sep 23 00:29:58 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez" returned: 1 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_r08rvgez' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b28e5de-b810-4bd1-95d9-6beabfd8f18c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD Sep 23 00:29:59 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] 0372fb84-b9ec-4156-81ef-452ae7f0ea37 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:29:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c Sep 23 00:29:59 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" returned: 0 in 2.188s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_fvwkev1xdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:01 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Converted 112.00 MB image at 51.16 MB/s Sep 23 00:30:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1G Sep 23 00:30:01 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c 1G" returned: 0 in 0.435s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Downloaded image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 for user d4abdfc392674b44ad95c2293b8d095b is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Marking volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Copying metadata from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 to 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Creating volume glance metadata for volume 871e2f0d-e2f1-4dd9-90af-46ccbc0e209c backed by image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09acfb30-b731-4963-b748-a3e0834d1fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046d3fa0-6634-4085-a0e2-a4c846d7c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Volume volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c (871e2f0d-e2f1-4dd9-90af-46ccbc0e209c): created successfully Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046d3fa0-6634-4085-a0e2-a4c846d7c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (a8293a0d-8524-4225-8e33-14a2d00ee01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d19cb559-7048-4a75-8858-f25fad178a57 tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (80a4529f-adec-43c5-b658-8902ddff80ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f09959-2f1f-4324-af1a-28a62b70c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f09959-2f1f-4324-af1a-28a62b70c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-81838762',display_name='tempest-VolumesGetTest-Volume-2072578021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a9a96b-35b9-4d13-a71b-0414da0ef5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:04Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e65c3-2777-4dda-8624-a3fd6bc3a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7e65c3-2777-4dda-8624-a3fd6bc3a51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49508a36-1a88-40d6-a7d7-c108b8f5fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49508a36-1a88-40d6-a7d7-c108b8f5fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a9a96b-35b9-4d13-a71b-0414da0ef5bc', 'volume_name': 'volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9125beb3-4085-46c3-9b36-04739add440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9125beb3-4085-46c3-9b36-04739add440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557d7c7b-bdf9-4416-a092-e183b2c5864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Volume 46a9a96b-35b9-4d13-a71b-0414da0ef5bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc', 'volume_size': 1} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-81838762',display_name='tempest-VolumesGetTest-Volume-2072578021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a9a96b-35b9-4d13-a71b-0414da0ef5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c363321af4c14a7cb0bcf3763b2f8cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:04Z,use_quota=True,user_id='d4abdfc392674b44ad95c2293b8d095b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Creating volume 46a9a96b-35b9-4d13-a71b-0414da0ef5bc {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:30:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:03 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc 1073741824 Sep 23 00:30:03 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc 1073741824" returned: 0 in 0.584s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:04 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc Sep 23 00:30:04 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557d7c7b-bdf9-4416-a092-e183b2c5864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc354cd5-03dc-4c62-97ab-16a5540478fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Volume volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc (46a9a96b-35b9-4d13-a71b-0414da0ef5bc): created successfully Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc354cd5-03dc-4c62-97ab-16a5540478fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Flow 'volume_create_manager' (80a4529f-adec-43c5-b658-8902ddff80ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2d4ec642-fc8f-45c7-877d-c41ece68e265 tempest-VolumesGetTest-187652521 None] Created volume successfully. Sep 23 00:30:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-46a9a96b-35b9-4d13-a71b-0414da0ef5bc-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "cinder-46a9a96b-35b9-4d13-a71b-0414da0ef5bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d7917-d5ff-405d-a388-0a47d1365ebf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc Sep 23 00:30:06 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:06 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:06 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc Sep 23 00:30:06 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:06 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-46a9a96b-35b9-4d13-a71b-0414da0ef5bc" released by "delete_volume" :: held 0.849s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Created reservations ['267d9da3-d828-42a6-9b4b-f991b683e3bf', '2fdd4c1e-258f-4369-9be5-a9808078023b', '12d45477-8032-45f0-a15f-e7f5ef681b4c', '650c6761-d136-4e01-b626-e3d96cb7520d', 'de543081-991a-4ba0-b4c5-a6181abc3749'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:07 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:30:07 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "cinder-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Acquiring lock "cinder-quobyte-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3e120-1bb8-4622-9d6a-49d6cb1c989a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:07 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a07f269-9fa8-4adb-96b9-0c96bb14c6cf tempest-VolumesGetTest-187652521 None] Lock "cinder-46a9a96b-35b9-4d13-a71b-0414da0ef5bc-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:07 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c Sep 23 00:30:07 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:07 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:07 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c Sep 23 00:30:07 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:08 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "cinder-quobyte-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c" released by "delete_volume" :: held 0.783s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Created reservations ['7c414d84-31ce-4a49-bf48-52604a7f76c0', '5a418d34-64d9-4f77-b7e2-015d7360356e', '883fd0c2-a02e-488d-95e8-2a790502c128', '2915f3bd-72e9-4261-bc8a-bf01023039b6', '19094b6a-1db3-4276-b2f1-dc4edfff667f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:08 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:30:08 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:08 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Deleted volume successfully. Sep 23 00:30:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d783f0fb-fe74-42c3-b34d-d5df4c2342a3 tempest-VolumesGetTest-187652521 None] Lock "cinder-871e2f0d-e2f1-4dd9-90af-46ccbc0e209c-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:18 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=68,cinder:DELETE=5,cinder:SELECT=60,cinder:INSERT=24 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:18 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=75,cinder:SELECT=59,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:30:37 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Flow 'volume_create_manager' (e24a6f16-6d1e-458e-8c62-d3ffb21cbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d059e962-4791-47c7-b06b-27351a66e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d059e962-4791-47c7-b06b-27351a66e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-14407166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a3640c-7e2e-48cb-a60c-55fec919fe38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50752c1b8a82469599afd20bc9308803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:44Z,use_quota=True,user_id='113a7bc83c094405b65162a434952d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b29c35-4073-4c7b-a21d-3dc4ba35a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b29c35-4073-4c7b-a21d-3dc4ba35a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2055e4-e353-4299-b0ad-2940a760a4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2055e4-e353-4299-b0ad-2940a760a4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a3640c-7e2e-48cb-a60c-55fec919fe38', 'volume_name': 'volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de52b884-8511-42de-a73e-32dce7a059e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de52b884-8511-42de-a73e-32dce7a059e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0738c5df-2061-48eb-8fca-bbfd389af0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume d2a3640c-7e2e-48cb-a60c-55fec919fe38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38', 'volume_size': 1} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-14407166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a3640c-7e2e-48cb-a60c-55fec919fe38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50752c1b8a82469599afd20bc9308803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:44Z,use_quota=True,user_id='113a7bc83c094405b65162a434952d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Creating volume d2a3640c-7e2e-48cb-a60c-55fec919fe38 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:44 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:30:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 1073741824 Sep 23 00:30:44 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Flow 'volume_create_manager' (97f2a0ca-092e-4678-b503-115f70cdd299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab24b765-20c9-4b0c-8d36-686b58bd7128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab24b765-20c9-4b0c-8d36-686b58bd7128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-110273706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67fcfed-3f24-40da-966d-9489b4742e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50752c1b8a82469599afd20bc9308803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:45Z,use_quota=True,user_id='113a7bc83c094405b65162a434952d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a68fe28-632b-4e0e-af6f-346b3b51766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a68fe28-632b-4e0e-af6f-346b3b51766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12609ac0-22f8-4791-8b51-ab72f4ee1309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12609ac0-22f8-4791-8b51-ab72f4ee1309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67fcfed-3f24-40da-966d-9489b4742e4a', 'volume_name': 'volume-e67fcfed-3f24-40da-966d-9489b4742e4a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8302a84-8392-4435-9693-b8391d0da7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8302a84-8392-4435-9693-b8391d0da7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6099317-4039-4216-b98c-c48e97fec9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume e67fcfed-3f24-40da-966d-9489b4742e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67fcfed-3f24-40da-966d-9489b4742e4a', 'volume_size': 1} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:45 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 1073741824" returned: 0 in 0.706s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 Sep 23 00:30:45 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38" returned: 0 in 0.401s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-110273706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67fcfed-3f24-40da-966d-9489b4742e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50752c1b8a82469599afd20bc9308803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:45Z,use_quota=True,user_id='113a7bc83c094405b65162a434952d6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Creating volume e67fcfed-3f24-40da-966d-9489b4742e4a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a 1073741824 Sep 23 00:30:45 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0738c5df-2061-48eb-8fca-bbfd389af0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ff0fe5-54ca-44b9-a39e-31d08c0b7b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 (d2a3640c-7e2e-48cb-a60c-55fec919fe38): created successfully Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ff0fe5-54ca-44b9-a39e-31d08c0b7b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Flow 'volume_create_manager' (e24a6f16-6d1e-458e-8c62-d3ffb21cbd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-61bef207-4e63-4fd9-a844-0dbedee01e43 tempest-TestServerVolumeAttachmentScenario-711830754 None] Created volume successfully. Sep 23 00:30:46 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a 1073741824" returned: 0 in 0.656s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a Sep 23 00:30:46 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6099317-4039-4216-b98c-c48e97fec9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67fcfed-3f24-40da-966d-9489b4742e4a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd6ab37-3a9f-4b25-9529-43dbf80ee12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Volume volume-e67fcfed-3f24-40da-966d-9489b4742e4a (e67fcfed-3f24-40da-966d-9489b4742e4a): created successfully Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd6ab37-3a9f-4b25-9529-43dbf80ee12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Flow 'volume_create_manager' (97f2a0ca-092e-4678-b503-115f70cdd299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2b00ccfe-22f9-49fe-806e-30f5f77e0324 tempest-TestServerVolumeAttachmentScenario-711830754 None] Created volume successfully. Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Flow 'volume_create_manager' (a61f1fa8-ed9d-42cd-88d1-19d8e4696362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2661737-ecf3-4109-81c4-bc462128fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2661737-ecf3-4109-81c4-bc462128fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-852067326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8282e7e-e49b-472b-bb00-9496ea851b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e61856f64049c18b1793722d535cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:48Z,use_quota=True,user_id='56914f447304482f988f2b6d1e2f08cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fca9c45-2dbe-40c4-881c-bd785427f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fca9c45-2dbe-40c4-881c-bd785427f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c6fcca-cf69-4b48-a2c1-0a0b81be8198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c6fcca-cf69-4b48-a2c1-0a0b81be8198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8282e7e-e49b-472b-bb00-9496ea851b8a', 'volume_name': 'volume-d8282e7e-e49b-472b-bb00-9496ea851b8a', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d88df8f-4bfc-4791-9594-79bf6515fe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d88df8f-4bfc-4791-9594-79bf6515fe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef76f0c-f39d-4c3b-9675-b4e274df72be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Volume d8282e7e-e49b-472b-bb00-9496ea851b8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8282e7e-e49b-472b-bb00-9496ea851b8a', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Trying to clone d8282e7e-e49b-472b-bb00-9496ea851b8a from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:30:48 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7561bc6-bd19-4ae3-a123-411e81ed5fc9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:48 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD Sep 23 00:30:48 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 is fetched for user 56914f447304482f988f2b6d1e2f08cf. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce6ffe7-2a76-414f-b82f-117c403d6de9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD Sep 23 00:30:49 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-852067326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8282e7e-e49b-472b-bb00-9496ea851b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e61856f64049c18b1793722d535cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:48Z,use_quota=True,user_id='56914f447304482f988f2b6d1e2f08cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Creating volume d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:49 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:30:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1073741824 Sep 23 00:30:49 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1073741824" returned: 0 in 0.569s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a Sep 23 00:30:50 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Attempting download of 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume d8282e7e-e49b-472b-bb00-9496ea851b8a. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ff3374-17c5-4c85-8a89-0e70b62af60e]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r Sep 23 00:30:50 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r Sep 23 00:30:51 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r" returned: 1 in 0.469s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0372fb84-b9ec-4156-81ef-452ae7f0ea37_5svjnn9r' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f354566d-d47b-43b3-ad81-ecfb145e966d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD Sep 23 00:30:51 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] 0372fb84-b9ec-4156-81ef-452ae7f0ea37 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:30:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a Sep 23 00:30:51 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:54 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a" returned: 0 in 2.541s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0372fb84-b9ec-4156-81ef-452ae7f0ea37_c23kd5p6devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:54 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Converted 112.00 MB image at 44.00 MB/s Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:54 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1G Sep 23 00:30:54 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:54 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a 1G" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Downloaded image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 ((None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}])) to volume d8282e7e-e49b-472b-bb00-9496ea851b8a successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Temporary image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 for user 56914f447304482f988f2b6d1e2f08cf is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Marking volume d8282e7e-e49b-472b-bb00-9496ea851b8a as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Copying metadata from image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 to d8282e7e-e49b-472b-bb00-9496ea851b8a. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:30:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Creating volume glance metadata for volume d8282e7e-e49b-472b-bb00-9496ea851b8a backed by image 0372fb84-b9ec-4156-81ef-452ae7f0ea37 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:30:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef76f0c-f39d-4c3b-9675-b4e274df72be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8282e7e-e49b-472b-bb00-9496ea851b8a', 'volume_size': 1, 'image_id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea946aa5bd2e4a90841d604267870911', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0372fb84-b9ec-4156-81ef-452ae7f0ea37', 'created_at': datetime.datetime(2026, 9, 22, 22, 5, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 5, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0372fb84-b9ec-4156-81ef-452ae7f0ea37/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dee9ebc-3de6-4c8b-959a-bafff986fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Volume volume-d8282e7e-e49b-472b-bb00-9496ea851b8a (d8282e7e-e49b-472b-bb00-9496ea851b8a): created successfully Sep 23 00:30:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dee9ebc-3de6-4c8b-959a-bafff986fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Flow 'volume_create_manager' (a61f1fa8-ed9d-42cd-88d1-19d8e4696362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e8fe53ea-53fc-4131-ae74-ffca136fb546 tempest-TestShelveInstance-745838430 None] Created volume successfully. Sep 23 00:30:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e798a52a-e3ba-475f-969f-391f86162510 req-f887b26a-e472-4597-8d8f-8cc8de42e8d5 tempest-TestShelveInstance-745838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e798a52a-e3ba-475f-969f-391f86162510 req-f887b26a-e472-4597-8d8f-8cc8de42e8d5 tempest-TestShelveInstance-745838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-e798a52a-e3ba-475f-969f-391f86162510 req-f887b26a-e472-4597-8d8f-8cc8de42e8d5 tempest-TestShelveInstance-745838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-e798a52a-e3ba-475f-969f-391f86162510 req-f887b26a-e472-4597-8d8f-8cc8de42e8d5 tempest-TestShelveInstance-745838430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-d8282e7e-e49b-472b-bb00-9496ea851b8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c08d857-25b9-4fb5-917e-3e704712f516', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:30:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-e798a52a-e3ba-475f-969f-391f86162510 req-f887b26a-e472-4597-8d8f-8cc8de42e8d5 tempest-TestShelveInstance-745838430 None] attachment_update completed successfully. Sep 23 00:31:09 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=15,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:09 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3982a62-c867-46f4-a1d1-d42215b8648e req-a6028e60-217e-47ab-b059-f0521516cc54 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3982a62-c867-46f4-a1d1-d42215b8648e req-a6028e60-217e-47ab-b059-f0521516cc54 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3982a62-c867-46f4-a1d1-d42215b8648e req-a6028e60-217e-47ab-b059-f0521516cc54 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d3982a62-c867-46f4-a1d1-d42215b8648e req-a6028e60-217e-47ab-b059-f0521516cc54 tempest-TestServerVolumeAttachmentScenario-711830754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ad7b3a8-1b38-47c5-86e2-919e8a7b6d69', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d3982a62-c867-46f4-a1d1-d42215b8648e req-a6028e60-217e-47ab-b059-f0521516cc54 tempest-TestServerVolumeAttachmentScenario-711830754 None] attachment_update completed successfully. Sep 23 00:31:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3a99e3cb-9744-4b38-9f31-7c752566e412 req-01a5c36f-5b79-4885-aa50-24c693dcd372 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3a99e3cb-9744-4b38-9f31-7c752566e412 req-01a5c36f-5b79-4885-aa50-24c693dcd372 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3a99e3cb-9744-4b38-9f31-7c752566e412 req-01a5c36f-5b79-4885-aa50-24c693dcd372 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-3a99e3cb-9744-4b38-9f31-7c752566e412 req-01a5c36f-5b79-4885-aa50-24c693dcd372 tempest-TestServerVolumeAttachmentScenario-711830754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-e67fcfed-3f24-40da-966d-9489b4742e4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06e09f56-ee90-48a1-95ec-5da71aaca994', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-3a99e3cb-9744-4b38-9f31-7c752566e412 req-01a5c36f-5b79-4885-aa50-24c693dcd372 tempest-TestServerVolumeAttachmentScenario-711830754 None] attachment_update completed successfully. Sep 23 00:31:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-ba7bc8b3-7bce-4ba6-b8b0-4d4c15458956 req-7c3188b9-6acd-4374-be9b-e063ad2789bb tempest-TestServerVolumeAttachmentScenario-711830754 None] Terminate volume connection completed successfully. Sep 23 00:31:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-ba7bc8b3-7bce-4ba6-b8b0-4d4c15458956 req-7c3188b9-6acd-4374-be9b-e063ad2789bb tempest-TestServerVolumeAttachmentScenario-711830754 None] Deleting attachment 06e09f56-ee90-48a1-95ec-5da71aaca994. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:31:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-69e9c651-eb92-4e49-835f-75671ce38d91 req-98fda681-ecc8-40ed-8366-4fa54a9f5900 tempest-TestServerVolumeAttachmentScenario-711830754 None] Terminate volume connection completed successfully. Sep 23 00:31:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-69e9c651-eb92-4e49-835f-75671ce38d91 req-98fda681-ecc8-40ed-8366-4fa54a9f5900 tempest-TestServerVolumeAttachmentScenario-711830754 None] Deleting attachment 4ad7b3a8-1b38-47c5-86e2-919e8a7b6d69. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "cinder-e67fcfed-3f24-40da-966d-9489b4742e4a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-e67fcfed-3f24-40da-966d-9489b4742e4a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "cinder-quobyte-e67fcfed-3f24-40da-966d-9489b4742e4a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-quobyte-e67fcfed-3f24-40da-966d-9489b4742e4a" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61c5de-2c5d-492b-a1c3-43dba8310c2b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:33 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a Sep 23 00:31:33 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:33 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:33 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a Sep 23 00:31:33 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:33 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e67fcfed-3f24-40da-966d-9489b4742e4a" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-quobyte-e67fcfed-3f24-40da-966d-9489b4742e4a" released by "delete_volume" :: held 0.746s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Created reservations ['bc339c76-c721-4be2-95db-4dcea6bc4a32', 'c758c530-dda3-446d-be63-473f302c8db7', '5b5d56c3-3efc-4b85-a779-4c02823d386e', '8b447338-0490-4417-b194-e10a8ccdcccb', 'd1309c7d-5114-42a7-8af7-fe01c5848ce4'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:31:34 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "cinder-d2a3640c-7e2e-48cb-a60c-55fec919fe38-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-d2a3640c-7e2e-48cb-a60c-55fec919fe38-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "cinder-quobyte-d2a3640c-7e2e-48cb-a60c-55fec919fe38" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:34 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.287s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-quobyte-d2a3640c-7e2e-48cb-a60c-55fec919fe38" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Deleted volume successfully. Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d29600-5d34-40d9-9e24-a04f19d6fc30]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e88d2944-5334-420a-ba3e-8b64707e4e88 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-e67fcfed-3f24-40da-966d-9489b4742e4a-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:34 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 Sep 23 00:31:34 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38 Sep 23 00:31:34 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d2a3640c-7e2e-48cb-a60c-55fec919fe38" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-quobyte-d2a3640c-7e2e-48cb-a60c-55fec919fe38" released by "delete_volume" :: held 0.739s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Created reservations ['a5794e25-55c3-4673-b5d1-faa389d57573', '03679a5d-9ec0-4ce9-87f0-6760c97b5f6d', 'cea8a082-5854-4f94-a479-bcf8700cfbe4', '28e254d9-9bcc-453b-818f-8a7ec7e298d7', '0c4c6f76-e3b9-4ef3-b38d-8ccd44ff04ec'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:35 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:31:35 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Deleted volume successfully. Sep 23 00:31:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5e7b1a35-3f84-4b56-bd2b-1d14aaed7625 tempest-TestServerVolumeAttachmentScenario-711830754 None] Lock "cinder-d2a3640c-7e2e-48cb-a60c-55fec919fe38-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:31:37 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=32,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-34300cff-2754-437e-8321-164410bf8a58 req-d719d8a3-b15c-4e0d-ac2c-84c9debc20c3 tempest-TestShelveInstance-745838430 None] Terminate volume connection completed successfully. Sep 23 00:31:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-34300cff-2754-437e-8321-164410bf8a58 req-d719d8a3-b15c-4e0d-ac2c-84c9debc20c3 tempest-TestShelveInstance-745838430 None] Deleting attachment 2c08d857-25b9-4fb5-917e-3e704712f516. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:31:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9abefa04-2282-4ea5-aa10-98a1a9c9fed9 req-f846ddaa-f407-449e-a72c-31d10957f518 tempest-TestShelveInstance-745838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9abefa04-2282-4ea5-aa10-98a1a9c9fed9 req-f846ddaa-f407-449e-a72c-31d10957f518 tempest-TestShelveInstance-745838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9abefa04-2282-4ea5-aa10-98a1a9c9fed9 req-f846ddaa-f407-449e-a72c-31d10957f518 tempest-TestShelveInstance-745838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9abefa04-2282-4ea5-aa10-98a1a9c9fed9 req-f846ddaa-f407-449e-a72c-31d10957f518 tempest-TestShelveInstance-745838430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-d8282e7e-e49b-472b-bb00-9496ea851b8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f97cb7ab-7c44-4daa-bd74-c88a08b850b3', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:31:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9abefa04-2282-4ea5-aa10-98a1a9c9fed9 req-f846ddaa-f407-449e-a72c-31d10957f518 tempest-TestShelveInstance-745838430 None] attachment_update completed successfully. Sep 23 00:32:02 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:02 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:15 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Flow 'volume_create_manager' (776b0971-3326-4981-876c-54fb6da36fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b659c26-9627-479d-8f19-22987cf938cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b659c26-9627-479d-8f19-22987cf938cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-216801797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b43d0b-bc54-45bf-bcc8-61af0c81bc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebae0a51fef4c7190ffd31fa45fe842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:19Z,use_quota=True,user_id='cd305632e7744b5396a79d0738931a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0b6e86-9874-4633-88af-aa4876ff22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0b6e86-9874-4633-88af-aa4876ff22f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11274100-dea0-4035-9aa0-009574bd6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11274100-dea0-4035-9aa0-009574bd6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b43d0b-bc54-45bf-bcc8-61af0c81bc31', 'volume_name': 'volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b4b984-99d0-41f2-89ae-b58db1422f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b4b984-99d0-41f2-89ae-b58db1422f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621d3086-7f07-406f-83ae-f8b7333e598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Volume 41b43d0b-bc54-45bf-bcc8-61af0c81bc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31', 'volume_size': 1} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-216801797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b43d0b-bc54-45bf-bcc8-61af0c81bc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebae0a51fef4c7190ffd31fa45fe842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:19Z,use_quota=True,user_id='cd305632e7744b5396a79d0738931a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Creating volume 41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:32:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 1073741824 Sep 23 00:32:18 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 1073741824" returned: 0 in 0.466s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:32:19 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621d3086-7f07-406f-83ae-f8b7333e598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86ce02d-b67d-424e-97c7-7d442794509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Volume volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 (41b43d0b-bc54-45bf-bcc8-61af0c81bc31): created successfully Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86ce02d-b67d-424e-97c7-7d442794509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Flow 'volume_create_manager' (776b0971-3326-4981-876c-54fb6da36fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8d4defa6-1949-4bcd-adda-152bf5d79bf0 tempest-TestStampPattern-1004156034 None] Created volume successfully. Sep 23 00:32:29 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:29 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:37 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:32:37 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:37 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-583b210f-0a76-467f-88cd-6f3bf0a0d7ad tempest-TestShelveInstance-745838430 None] Terminate volume connection completed successfully. Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-583b210f-0a76-467f-88cd-6f3bf0a0d7ad tempest-TestShelveInstance-745838430 None] Deleting attachment f97cb7ab-7c44-4daa-bd74-c88a08b850b3. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Acquiring lock "cinder-d8282e7e-e49b-472b-bb00-9496ea851b8a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "cinder-d8282e7e-e49b-472b-bb00-9496ea851b8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Acquiring lock "cinder-quobyte-d8282e7e-e49b-472b-bb00-9496ea851b8a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "cinder-quobyte-d8282e7e-e49b-472b-bb00-9496ea851b8a" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea4f2ed-6d50-4379-b9c5-97d65556c3b6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a Sep 23 00:32:40 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:40 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:40 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a Sep 23 00:32:40 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:41 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d8282e7e-e49b-472b-bb00-9496ea851b8a" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "cinder-quobyte-d8282e7e-e49b-472b-bb00-9496ea851b8a" released by "delete_volume" :: held 0.879s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.quota [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Created reservations ['043f40b4-372b-4505-995c-e004dc8d344c', 'dc6a78cb-c81a-4cfc-8d0b-190b7fee7411', '9b371f08-8cb9-4d7a-8589-c2a2a0cd3a58', 'be6ddc01-c42f-405b-9233-b85546d3acdf', 'f2b8b928-7fc4-494d-a766-6a3e99f66e69'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:41 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:32:41 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:41 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.manager [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Deleted volume successfully. Sep 23 00:32:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-95cc64b0-cb9b-4243-87d7-ac05688aded9 req-9dd0106c-91cc-421c-9e35-2fe37e0ef748 tempest-TestShelveInstance-745838430 None] Lock "cinder-d8282e7e-e49b-472b-bb00-9496ea851b8a-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cfe44f6f-767f-461b-ac21-f76d33d39e74 req-46c7c1d6-b0af-424e-a6af-c5aa14bb35b9 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cfe44f6f-767f-461b-ac21-f76d33d39e74 req-46c7c1d6-b0af-424e-a6af-c5aa14bb35b9 tempest-TestStampPattern-1004156034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-cfe44f6f-767f-461b-ac21-f76d33d39e74 req-46c7c1d6-b0af-424e-a6af-c5aa14bb35b9 tempest-TestStampPattern-1004156034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-cfe44f6f-767f-461b-ac21-f76d33d39e74 req-46c7c1d6-b0af-424e-a6af-c5aa14bb35b9 tempest-TestStampPattern-1004156034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7824f3ca-8880-43c5-b757-3718f7b16b5d', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:32:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-cfe44f6f-767f-461b-ac21-f76d33d39e74 req-46c7c1d6-b0af-424e-a6af-c5aa14bb35b9 tempest-TestStampPattern-1004156034 None] attachment_update completed successfully. Sep 23 00:32:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-8225da38-b1cd-491d-9173-ce3bf3c8671a req-f8c86810-fa58-4a71-b5ae-069928c85904 tempest-TestStampPattern-1004156034 None] Terminate volume connection completed successfully. Sep 23 00:32:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-8225da38-b1cd-491d-9173-ce3bf3c8671a req-f8c86810-fa58-4a71-b5ae-069928c85904 tempest-TestStampPattern-1004156034 None] Deleting attachment 7824f3ca-8880-43c5-b757-3718f7b16b5d. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Creating offline snapshot 2ee3644a-ff59-425e-b14a-6f9bd6d901e1 of volume 41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d01930-f262-4586-b945-9ab6bc2cebbf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:32:58 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 1G Sep 23 00:32:58 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 1G" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:32:59 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 is being set with open permissions: ugo+rw Sep 23 00:32:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:32:59 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info Sep 23 00:33:00 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info is being set with open permissions: ugo+rw Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info Sep 23 00:33:00 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.info" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f1b89fe1-25ca-4876-b90f-5afa12119aca tempest-TestStampPattern-1004156034 None] Create snapshot completed successfully Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Flow 'volume_create_manager' (8b386f17-27f9-46cd-b5d0-528c84315779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23320257-9171-4108-944e-0c2514807347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23320257-9171-4108-944e-0c2514807347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1220946277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f45dc81-73e8-4dd2-bb90-c9c6a04185f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebae0a51fef4c7190ffd31fa45fe842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ee3644a-ff59-425e-b14a-6f9bd6d901e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:10Z,use_quota=True,user_id='cd305632e7744b5396a79d0738931a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cd523a-c59d-4076-b182-f1c50341b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cd523a-c59d-4076-b182-f1c50341b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e865a906-899b-4356-8d00-646fbebf9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e865a906-899b-4356-8d00-646fbebf9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f45dc81-73e8-4dd2-bb90-c9c6a04185f9', 'volume_name': 'volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9', 'volume_size': 1, 'snapshot_id': '2ee3644a-ff59-425e-b14a-6f9bd6d901e1'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee0b2d2-4384-4cca-800c-b0bd3dfba7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee0b2d2-4384-4cca-800c-b0bd3dfba7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21581304-9423-4c9a-a178-281b9ff0861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Volume 6f45dc81-73e8-4dd2-bb90-c9c6a04185f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9', 'volume_size': 1, 'snapshot_id': '2ee3644a-ff59-425e-b14a-6f9bd6d901e1'} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Creating volume 6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 from snapshot 2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] snapshot: 2ee3644a-ff59-425e-b14a-6f9bd6d901e1, volume: 6f45dc81-73e8-4dd2-bb90-c9c6a04185f9, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[da711a66-031d-4879-9c5e-9a17ec15687e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:33:10 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed7966-6ad2-4848-be6f-9cb3f3fdfa3e]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:33:11 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.550s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:33:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 Sep 23 00:33:11 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=17,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=23,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:21 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" returned: 0 in 9.754s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31, size 1024.00 MB, duration 9.76 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:21 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Converted 1024.00 MB image at 104.97 MB/s Sep 23 00:33:21 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 is being set with open permissions: ugo+rw Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 Sep 23 00:33:21 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" released by "_copy_volume_from_snapshot" :: held 11.340s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" released by "_create_volume_from_snapshot" :: held 11.449s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.475s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21581304-9423-4c9a-a178-281b9ff0861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9', 'volume_size': 1, 'snapshot_id': '2ee3644a-ff59-425e-b14a-6f9bd6d901e1'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac212a47-68ed-4231-8c01-37b7eefb8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Volume volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 (6f45dc81-73e8-4dd2-bb90-c9c6a04185f9): created successfully Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac212a47-68ed-4231-8c01-37b7eefb8be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Flow 'volume_create_manager' (8b386f17-27f9-46cd-b5d0-528c84315779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8e3a0901-260c-45cd-8335-e145e0bb00c7 tempest-TestStampPattern-1004156034 None] Created volume successfully. Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Flow 'volume_create_manager' (eb46a9bd-0bc3-4d78-8575-a7d52a03f6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39a8a9-b4cc-46d8-8f43-0d0809bf07fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e39a8a9-b4cc-46d8-8f43-0d0809bf07fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-343648804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c931851-c806-4924-8d2a-01dce83785a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41b9920350c42afb35e803dd3e00c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:29Z,use_quota=True,user_id='8bb3c43edf944c6a9e4c389dd6866665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff153423-d184-4f2c-b927-f33cd7fe84ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff153423-d184-4f2c-b927-f33cd7fe84ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699029d6-b88c-4c17-b780-928c6d45f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699029d6-b88c-4c17-b780-928c6d45f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c931851-c806-4924-8d2a-01dce83785a3', 'volume_name': 'volume-5c931851-c806-4924-8d2a-01dce83785a3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30e151b-8b84-45d9-9a41-ff4500473f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30e151b-8b84-45d9-9a41-ff4500473f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f86b0d-12e2-48ec-bad8-194fdb5c154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Volume 5c931851-c806-4924-8d2a-01dce83785a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c931851-c806-4924-8d2a-01dce83785a3', 'volume_size': 1} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-343648804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c931851-c806-4924-8d2a-01dce83785a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41b9920350c42afb35e803dd3e00c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:29Z,use_quota=True,user_id='8bb3c43edf944c6a9e4c389dd6866665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Creating volume 5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:28 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:33:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 1073741824 Sep 23 00:33:28 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 1073741824" returned: 0 in 0.603s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:33:29 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f86b0d-12e2-48ec-bad8-194fdb5c154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c931851-c806-4924-8d2a-01dce83785a3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27f33be-912a-4eb0-bda5-b228427587f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Volume volume-5c931851-c806-4924-8d2a-01dce83785a3 (5c931851-c806-4924-8d2a-01dce83785a3): created successfully Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27f33be-912a-4eb0-bda5-b228427587f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Flow 'volume_create_manager' (eb46a9bd-0bc3-4d78-8575-a7d52a03f6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3b547aa4-543c-4b6f-8935-a6c4f8496eaf tempest-TestImageHashVerification-1285705509 None] Created volume successfully. Sep 23 00:33:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da941dc-637e-4824-b612-abef5cf284ca]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:33:31 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9944ffcd-9193-42a1-9e9c-2f48f53f493c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:33:32 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 /opt/stack/data/cinder/conversion/5c931851-c806-4924-8d2a-01dce83785a3.temp_image.4f36578e-7887-4c2a-bb9a-539c4f6a4708b5xvygvp.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 /opt/stack/data/cinder/conversion/5c931851-c806-4924-8d2a-01dce83785a3.temp_image.4f36578e-7887-4c2a-bb9a-539c4f6a4708b5xvygvp.img Sep 23 00:33:32 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:37 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:33:37 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:39 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 /opt/stack/data/cinder/conversion/5c931851-c806-4924-8d2a-01dce83785a3.temp_image.4f36578e-7887-4c2a-bb9a-539c4f6a4708b5xvygvp.img" returned: 0 in 7.122s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b624c19-030e-42ac-a414-b26b4e5fd92a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:39 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:33:39 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3, size 1024.00 MB, duration 7.12 sec, destination /opt/stack/data/cinder/conversion/5c931851-c806-4924-8d2a-01dce83785a3.temp_image.4f36578e-7887-4c2a-bb9a-539c4f6a4708b5xvygvp.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:33:40 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Converted 1024.00 MB image at 143.77 MB/s Sep 23 00:33:40 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] 4f36578e-7887-4c2a-bb9a-539c4f6a4708 was raw, no need to convert to raw {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:33:50 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c192e33-7254-4bb6-bb8c-cc651391b78d req-380b192c-6c9c-41c6-9444-1b716a1eed05 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.771s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Uploaded volume to glance image-id: 4f36578e-7887-4c2a-bb9a-539c4f6a4708. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:34:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c192e33-7254-4bb6-bb8c-cc651391b78d req-380b192c-6c9c-41c6-9444-1b716a1eed05 tempest-TestStampPattern-1004156034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.882s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9c192e33-7254-4bb6-bb8c-cc651391b78d req-380b192c-6c9c-41c6-9444-1b716a1eed05 tempest-TestStampPattern-1004156034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d543e017-54a5-478a-9f7b-98d6f0846921 tempest-TestImageHashVerification-1285705509 None] Copy volume to image completed successfully. Sep 23 00:34:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9c192e33-7254-4bb6-bb8c-cc651391b78d req-380b192c-6c9c-41c6-9444-1b716a1eed05 tempest-TestStampPattern-1004156034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771', 'name': 'volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '292d4f60-57af-468c-ad20-01bdce92d070', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:34:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9c192e33-7254-4bb6-bb8c-cc651391b78d req-380b192c-6c9c-41c6-9444-1b716a1eed05 tempest-TestStampPattern-1004156034 None] attachment_update completed successfully. Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Acquiring lock "cinder-5c931851-c806-4924-8d2a-01dce83785a3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "cinder-5c931851-c806-4924-8d2a-01dce83785a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Acquiring lock "cinder-quobyte-5c931851-c806-4924-8d2a-01dce83785a3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "cinder-quobyte-5c931851-c806-4924-8d2a-01dce83785a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac33be1-8c38-4696-8baf-305e8a5aae3c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:34:01 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3 Sep 23 00:34:02 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-5c931851-c806-4924-8d2a-01dce83785a3" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "cinder-quobyte-5c931851-c806-4924-8d2a-01dce83785a3" released by "delete_volume" :: held 0.725s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Created reservations ['21d24a5a-affb-4100-925b-e3e9962c2969', 'b6f4c1c8-95c1-46f1-baea-ee064de3d371', 'a23b6cc4-df1f-47c4-825e-2d2ebfed2c3d', 'f0cf5c02-8b13-46c6-9343-b1541a47a43e', 'f7bce8bf-3456-406e-a921-b7fdd18975c9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:02 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.297s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Deleted volume successfully. Sep 23 00:34:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d47b5275-e486-4a14-977e-f0a0adbd9286 tempest-TestImageHashVerification-1285705509 None] Lock "cinder-5c931851-c806-4924-8d2a-01dce83785a3-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-97b27b05-4cc8-477b-a8ce-665365e6287f req-bcee84e6-a455-4b1a-b2ef-42f9bb4bcf10 tempest-TestStampPattern-1004156034 None] Terminate volume connection completed successfully. Sep 23 00:34:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-97b27b05-4cc8-477b-a8ce-665365e6287f req-bcee84e6-a455-4b1a-b2ef-42f9bb4bcf10 tempest-TestStampPattern-1004156034 None] Deleting attachment 292d4f60-57af-468c-ad20-01bdce92d070. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "cinder-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abc08f9-b2ba-4155-8df4-ecaa8b8bc8fe]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 Sep 23 00:34:09 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:09 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9 Sep 23 00:34:09 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:09 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9" released by "delete_volume" :: held 0.799s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Created reservations ['ce3a5004-9588-492f-9dc5-2ea4ce72914e', '571d53c9-3193-4a9f-a7f7-b5f293f95186', 'c1097ca2-4036-4219-96d4-028c45f3d735', 'd8f3943d-e39f-4ddb-be3e-618659b4f679', '56858baa-2fee-4740-865c-9b641fc55e27'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:10 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Deleted volume successfully. Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9646fc65-8ede-44e7-9984-184babd9b84a tempest-TestStampPattern-1004156034 None] Lock "cinder-6f45dc81-73e8-4dd2-bb90-c9c6a04185f9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Deleting offline snapshot 2ee3644a-ff59-425e-b14a-6f9bd6d901e1 of volume 41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] snapshot_file for this snap is: volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6a6df-3398-425b-9d56-3a97a2351cb5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:34:10 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c9837-f56a-4c26-8a68-d5c454088f0d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:34:11 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.574s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:34:11 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1 Sep 23 00:34:12 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31.2ee3644a-ff59-425e-b14a-6f9bd6d901e1" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-2ee3644a-ff59-425e-b14a-6f9bd6d901e1" released by "_delete_snapshot" :: held 1.754s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" released by "delete_snapshot" :: held 1.779s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Created reservations ['72d7d1ad-7958-4b50-92d7-37d15cfaf29b', 'f416d23e-d923-4651-b9d1-aec676b56b03', '339c93cf-9bb8-4f3f-8559-d207d5b67a46', 'a7189dde-421f-4f59-a1f8-d0e3517d7c49', '3762f4f5-8c85-40a4-b3de-543e83fa1474'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Delete snapshot completed successfully. Sep 23 00:34:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d9f44d6c-2047-48a0-b8db-4ab8f0f96e94 tempest-TestStampPattern-1004156034 None] Lock "cinder-2ee3644a-ff59-425e-b14a-6f9bd6d901e1-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-41b43d0b-bc54-45bf-bcc8-61af0c81bc31-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "cinder-41b43d0b-bc54-45bf-bcc8-61af0c81bc31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Acquiring lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[de186407-8a5c-4dbd-9bcf-0903c3ab11b5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:34:17 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31 Sep 23 00:34:17 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "cinder-quobyte-41b43d0b-bc54-45bf-bcc8-61af0c81bc31" released by "delete_volume" :: held 0.853s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Created reservations ['c9ac01d7-b037-4f6d-9fc5-f62bf03ea3c0', '29542424-1a00-485b-8c6b-74f5d6b8e5fc', '453ca59d-24ab-483c-aa2c-09e5c76a7bac', '507e225d-b02b-4758-b2db-36bdb25fc5ab', 'f57b975d-91a7-426b-8b0f-755142d8ad42'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:17 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Deleted volume successfully. Sep 23 00:34:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-94deb189-c186-4f1b-9394-d0e7b3696710 tempest-TestStampPattern-1004156034 None] Lock "cinder-41b43d0b-bc54-45bf-bcc8-61af0c81bc31-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Flow 'volume_create_manager' (86263b10-98ec-442c-873e-de6ed2621a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13af5a-d843-4a4a-94a2-b217e8be77b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13af5a-d843-4a4a-94a2-b217e8be77b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bce96e-58fa-4ae5-aad3-b513ec41d370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6360d9d637423f97487589d5456b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:22Z,use_quota=True,user_id='2df0cecf731e473481ebababcae68b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a89a005a-5597-42f8-8ffb-fd38d62b151f),volume_type_id=a89a005a-5597-42f8-8ffb-fd38d62b151f)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57732562-2329-43b8-bc1d-494e5cbfc79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57732562-2329-43b8-bc1d-494e5cbfc79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6e93b4-cb48-4083-8088-d4279ce2c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6e93b4-cb48-4083-8088-d4279ce2c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47bce96e-58fa-4ae5-aad3-b513ec41d370', 'volume_name': 'volume-47bce96e-58fa-4ae5-aad3-b513ec41d370', 'volume_size': 1, 'image_id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9396ab2255bb3fb0df3c7e58c39dbe75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b6360d9d637423f97487589d5456b9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad6782adc51fbdb7ed33bb160f6ea8925b42a5ae91d3f34ce793dd8ee0c827f2f674e34c527b75be0a7a5f3a55f7ae39563edd674ea9e43902f219afe9708c85', 'id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a85c12a-42eb-4374-9780-b3a51f1da4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a85c12a-42eb-4374-9780-b3a51f1da4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefcf473-c901-4e1a-8059-fc6969bf6612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Volume 47bce96e-58fa-4ae5-aad3-b513ec41d370: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47bce96e-58fa-4ae5-aad3-b513ec41d370', 'volume_size': 1, 'image_id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9396ab2255bb3fb0df3c7e58c39dbe75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b6360d9d637423f97487589d5456b9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad6782adc51fbdb7ed33bb160f6ea8925b42a5ae91d3f34ce793dd8ee0c827f2f674e34c527b75be0a7a5f3a55f7ae39563edd674ea9e43902f219afe9708c85', 'id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Trying to clone 47bce96e-58fa-4ae5-aad3-b513ec41d370 from image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:34:22 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e211c-5478-4a1a-8459-11b30a0ca45f]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:22 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:23 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Temporary image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd is fetched for user 2df0cecf731e473481ebababcae68b93. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[41204999-5cee-4213-a230-6ba35b272f98]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:23 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:24 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bce96e-58fa-4ae5-aad3-b513ec41d370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6360d9d637423f97487589d5456b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:22Z,use_quota=True,user_id='2df0cecf731e473481ebababcae68b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a89a005a-5597-42f8-8ffb-fd38d62b151f),volume_type_id=a89a005a-5597-42f8-8ffb-fd38d62b151f)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Creating volume 47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1073741824 Sep 23 00:34:24 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1073741824" returned: 0 in 0.543s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 Sep 23 00:34:25 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Attempting download of 0e55c981-dbf1-445c-86f8-a3a4782b8bfd ((None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}])) to volume 47bce96e-58fa-4ae5-aad3-b513ec41d370. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0cbaa5-58da-4422-a7e1-e5c1263418d3]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql Sep 23 00:34:25 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql Sep 23 00:34:25 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql" returned: 1 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0e55c981-dbf1-445c-86f8-a3a4782b8bfd__e0eufql' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34b1ee-2ebd-40ca-82e3-76cfee381b97]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:26 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD Sep 23 00:34:26 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] 0e55c981-dbf1-445c-86f8-a3a4782b8bfd was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 Sep 23 00:34:27 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0e55c981-dbf1-445c-86f8-a3a4782b8bfd_lowj021mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:27 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:34:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1G Sep 23 00:34:27 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 1G" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Downloaded image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd ((None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}])) to volume 47bce96e-58fa-4ae5-aad3-b513ec41d370 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Temporary image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd for user 2df0cecf731e473481ebababcae68b93 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Marking volume 47bce96e-58fa-4ae5-aad3-b513ec41d370 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Copying metadata from image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd to 47bce96e-58fa-4ae5-aad3-b513ec41d370. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Creating volume glance metadata for volume 47bce96e-58fa-4ae5-aad3-b513ec41d370 backed by image 0e55c981-dbf1-445c-86f8-a3a4782b8bfd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9396ab2255bb3fb0df3c7e58c39dbe75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefcf473-c901-4e1a-8059-fc6969bf6612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bce96e-58fa-4ae5-aad3-b513ec41d370', 'volume_size': 1, 'image_id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9396ab2255bb3fb0df3c7e58c39dbe75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b6360d9d637423f97487589d5456b9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ad6782adc51fbdb7ed33bb160f6ea8925b42a5ae91d3f34ce793dd8ee0c827f2f674e34c527b75be0a7a5f3a55f7ae39563edd674ea9e43902f219afe9708c85', 'id': '0e55c981-dbf1-445c-86f8-a3a4782b8bfd', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0e55c981-dbf1-445c-86f8-a3a4782b8bfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc4ab2e-ea35-46a0-89c1-bcf226b1c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Volume volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 (47bce96e-58fa-4ae5-aad3-b513ec41d370): created successfully Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc4ab2e-ea35-46a0-89c1-bcf226b1c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Flow 'volume_create_manager' (86263b10-98ec-442c-873e-de6ed2621a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-96c187f7-5f2f-4320-8b49-7a9c6c6132e0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Created volume successfully. Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Acquiring lock "cinder-47bce96e-58fa-4ae5-aad3-b513ec41d370-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "cinder-47bce96e-58fa-4ae5-aad3-b513ec41d370-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Acquiring lock "cinder-quobyte-47bce96e-58fa-4ae5-aad3-b513ec41d370" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "cinder-quobyte-47bce96e-58fa-4ae5-aad3-b513ec41d370" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b1f71-4536-442f-a128-736875af5825]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 Sep 23 00:34:28 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:29 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:29 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370 Sep 23 00:34:29 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:29 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-47bce96e-58fa-4ae5-aad3-b513ec41d370" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "cinder-quobyte-47bce96e-58fa-4ae5-aad3-b513ec41d370" released by "delete_volume" :: held 0.765s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:29 devstack cinder-volume[86731]: WARNING cinder.quota [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:34:29 devstack cinder-volume[86731]: WARNING cinder.quota [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Created reservations ['503e16c4-9dd2-4fbe-940a-c9d5091ff916', '27b5fa7d-391b-4130-9bda-a36fda2a1ff3', '729a6888-6aa0-4f1d-ac50-1493fb8a571c', '7d82a888-9612-4c52-b566-0cb0e3608820', '1a6daef5-86e7-43ed-a909-56dce0e0aa24'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:29 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:29 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:29 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.337s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Deleted volume successfully. Sep 23 00:34:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-878fb347-84ba-4064-8b61-314965977cf0 tempest-VolumeAndVolumeTypeFromImageTest-12513460 None] Lock "cinder-47bce96e-58fa-4ae5-aad3-b513ec41d370-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (dc70ee1f-a540-4d04-8b92-4bc8f697f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85e6c35-e1a7-42eb-b715-046c27096153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85e6c35-e1a7-42eb-b715-046c27096153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366119092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0894b6d-f61f-44d9-bde8-b7bcf0eceb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e54d798-a0ce-4163-95d6-46a4eaca97e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e54d798-a0ce-4163-95d6-46a4eaca97e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107de880-04a9-4d6a-8207-1910be7cda46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107de880-04a9-4d6a-8207-1910be7cda46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0894b6d-f61f-44d9-bde8-b7bcf0eceb74', 'volume_name': 'volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7579e2f-6d5c-47c7-a1c9-3494bbb1d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7579e2f-6d5c-47c7-a1c9-3494bbb1d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad54517-1bbb-4aea-a76b-96a653fc28c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume b0894b6d-f61f-44d9-bde8-b7bcf0eceb74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74', 'volume_size': 1} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1366119092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0894b6d-f61f-44d9-bde8-b7bcf0eceb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:35Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Creating volume b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:35 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 1073741824 Sep 23 00:34:35 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 1073741824" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (558b82fc-ca5c-4152-b0c4-1e8feb7c0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3c663b-4b8d-424e-a88a-25febdb7190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3c663b-4b8d-424e-a88a-25febdb7190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757779814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc00102-ce5f-4a16-816c-0ec649f7dd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d458577-776b-4892-8722-5a751b3f2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d458577-776b-4892-8722-5a751b3f2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26258813-d907-4053-bc32-c888ece67696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26258813-d907-4053-bc32-c888ece67696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc00102-ce5f-4a16-816c-0ec649f7dd10', 'volume_name': 'volume-adc00102-ce5f-4a16-816c-0ec649f7dd10', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15633ef7-e7a2-4dcd-bf36-3dfe9ab0fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15633ef7-e7a2-4dcd-bf36-3dfe9ab0fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1004a-0adf-46b6-8178-c59157bd8484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Volume adc00102-ce5f-4a16-816c-0ec649f7dd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc00102-ce5f-4a16-816c-0ec649f7dd10', 'volume_size': 1} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:36 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 Sep 23 00:34:36 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Flow 'volume_create_manager' (33d481a3-f68f-418f-8824-3d68b3d8c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f89bc81-a140-4ea7-8665-3610a6cd7719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f89bc81-a140-4ea7-8665-3610a6cd7719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f979570d-aa32-411f-9e85-15edc9759a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb69c63446f44095b9f4f55174c6e054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='ca9dd0e8d2204003963a319ca103fa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b2a053-ec45-4ea1-b68f-5d5defd23e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b2a053-ec45-4ea1-b68f-5d5defd23e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9ab866-54d1-4adb-be02-cbe849c86fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (6744e6b0-e298-40a4-8ce0-fe2f9dca5b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bb1f6c-6934-4b8e-8e5b-a466141e18f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bb1f6c-6934-4b8e-8e5b-a466141e18f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314097755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7138de1c-8bbd-406c-9aba-283cf2e2048f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e2c2c7-11f0-408c-8a29-dacd78074379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e2c2c7-11f0-408c-8a29-dacd78074379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee03434c-0a7f-46db-ab40-941271fe0d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee03434c-0a7f-46db-ab40-941271fe0d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7138de1c-8bbd-406c-9aba-283cf2e2048f', 'volume_name': 'volume-7138de1c-8bbd-406c-9aba-283cf2e2048f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db50b9c3-a49b-4423-a386-d43fac6f8152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db50b9c3-a49b-4423-a386-d43fac6f8152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d3e693-3460-44a5-a81a-39e50443a083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Volume 7138de1c-8bbd-406c-9aba-283cf2e2048f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7138de1c-8bbd-406c-9aba-283cf2e2048f', 'volume_size': 1} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:36 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757779814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc00102-ce5f-4a16-816c-0ec649f7dd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Creating volume adc00102-ce5f-4a16-816c-0ec649f7dd10 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad54517-1bbb-4aea-a76b-96a653fc28c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 1073741824 Sep 23 00:34:36 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637bee32-d6b4-471e-85a1-f0e8767f2ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 (b0894b6d-f61f-44d9-bde8-b7bcf0eceb74): created successfully Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637bee32-d6b4-471e-85a1-f0e8767f2ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (dc70ee1f-a540-4d04-8b92-4bc8f697f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9ab866-54d1-4adb-be02-cbe849c86fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f979570d-aa32-411f-9e85-15edc9759a5f', 'volume_name': 'volume-f979570d-aa32-411f-9e85-15edc9759a5f', 'volume_size': 1, 'image_id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '315e1d4084bdeafc3fc4429d0d608657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb69c63446f44095b9f4f55174c6e054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6955de188e3aa7a40afe331baa4eaba3980467684b9db9d80cc3fc6c867cb5d4850b4cd8a66bca37fd6be6fc2ef97c9b4499d4910139bec2c97c2c38b6f2e39', 'id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0ac3cf-3384-4de7-bc56-00b35e3f4fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0ac3cf-3384-4de7-bc56-00b35e3f4fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1f3753-84ea-4e0e-bd85-21f8eb3061a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Volume f979570d-aa32-411f-9e85-15edc9759a5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f979570d-aa32-411f-9e85-15edc9759a5f', 'volume_size': 1, 'image_id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '315e1d4084bdeafc3fc4429d0d608657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb69c63446f44095b9f4f55174c6e054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6955de188e3aa7a40afe331baa4eaba3980467684b9db9d80cc3fc6c867cb5d4850b4cd8a66bca37fd6be6fc2ef97c9b4499d4910139bec2c97c2c38b6f2e39', 'id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a/file', 'properties': {}}, 'image_service': } Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Trying to clone f979570d-aa32-411f-9e85-15edc9759a5f from image d60ae946-8e17-4bb1-a951-0d0e46f7748a at location (None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1edaf9d0-70c5-4549-87c1-b7ea86a8d2a5 tempest-CreateVolumesFromImageTest-2119211847 None] Created volume successfully. Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:34:36 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43278b32-2728-4616-b542-c975f2663fd0]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (9bfd08f6-34bf-44dc-a168-7e98d4825639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3c3fab-91ab-4f90-94ee-4beeb388a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3c3fab-91ab-4f90-94ee-4beeb388a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588907910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f583ebb-0fa3-4feb-b5ad-83a995b9893a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d6915e-c3d0-4a87-b8cb-71fb1076db95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d6915e-c3d0-4a87-b8cb-71fb1076db95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:37 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1417d540-a2a3-40d9-9f0a-7fe5f456e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1417d540-a2a3-40d9-9f0a-7fe5f456e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f583ebb-0fa3-4feb-b5ad-83a995b9893a', 'volume_name': 'volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433ee0cf-4396-4881-881e-92f01109fd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433ee0cf-4396-4881-881e-92f01109fd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf208bd-c964-4aae-b089-0e25955fc0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume 7f583ebb-0fa3-4feb-b5ad-83a995b9893a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a', 'volume_size': 1} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 1073741824" returned: 0 in 0.714s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 Sep 23 00:34:37 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:37 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:37 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (18b7eb57-d4b8-417e-9807-91c025c62295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d2b5bb-2461-4c62-a7fa-5c37fa290099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d2b5bb-2461-4c62-a7fa-5c37fa290099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53639159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aa67f3-080a-4b9d-93aa-4f59308d5db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bea28e-e327-4979-b505-e9cf6ca11903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bea28e-e327-4979-b505-e9cf6ca11903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d1216a-4a1c-4b65-8fa5-e57a08b829dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d1216a-4a1c-4b65-8fa5-e57a08b829dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36aa67f3-080a-4b9d-93aa-4f59308d5db6', 'volume_name': 'volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb30c01d-9ff1-4274-ac40-458a2ba0e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb30c01d-9ff1-4274-ac40-458a2ba0e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa87b89-40fb-4274-9c39-0e3aa32499cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Volume 36aa67f3-080a-4b9d-93aa-4f59308d5db6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6', 'volume_size': 1} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10" returned: 0 in 0.338s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314097755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7138de1c-8bbd-406c-9aba-283cf2e2048f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Creating volume 7138de1c-8bbd-406c-9aba-283cf2e2048f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:37 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f 1073741824 Sep 23 00:34:37 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b1004a-0adf-46b6-8178-c59157bd8484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc00102-ce5f-4a16-816c-0ec649f7dd10', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaf0b63-3980-45a7-9e4e-6419b77467d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Temporary image d60ae946-8e17-4bb1-a951-0d0e46f7748a is fetched for user ca9dd0e8d2204003963a319ca103fa0a. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:34:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Volume volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 (adc00102-ce5f-4a16-816c-0ec649f7dd10): created successfully Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaf0b63-3980-45a7-9e4e-6419b77467d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (558b82fc-ca5c-4152-b0c4-1e8feb7c0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:37 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dabfca9f-a271-43b6-a975-7def96cbbe41 tempest-CreateVolumesFromImageTest-2119211847 None] Created volume successfully. Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[153dbb10-9d88-46ca-a3d6-9b0be94a8054]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:37 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:37 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f 1073741824" returned: 0 in 0.478s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f Sep 23 00:34:38 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:38 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588907910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f583ebb-0fa3-4feb-b5ad-83a995b9893a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Creating volume 7f583ebb-0fa3-4feb-b5ad-83a995b9893a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:38 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a 1073741824 Sep 23 00:34:38 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3d3e693-3460-44a5-a81a-39e50443a083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7138de1c-8bbd-406c-9aba-283cf2e2048f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8b9a61-5b17-4531-b68a-91798fba5b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:38 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Volume volume-7138de1c-8bbd-406c-9aba-283cf2e2048f (7138de1c-8bbd-406c-9aba-283cf2e2048f): created successfully Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8b9a61-5b17-4531-b68a-91798fba5b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (6744e6b0-e298-40a4-8ce0-fe2f9dca5b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f1cb9198-ae29-48fe-bbe6-fc8244b76449 tempest-CreateVolumesFromImageTest-2119211847 None] Created volume successfully. Sep 23 00:34:38 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a 1073741824" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a Sep 23 00:34:39 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53639159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aa67f3-080a-4b9d-93aa-4f59308d5db6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5bd4527814f41ad8116078d3c37d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:37Z,use_quota=True,user_id='989f31d5d83c4deb8628643bcbc5d02f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Creating volume 36aa67f3-080a-4b9d-93aa-4f59308d5db6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:39 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf208bd-c964-4aae-b089-0e25955fc0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 1073741824 Sep 23 00:34:39 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e30c6f-2890-4585-bdb6-6116660c15fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Volume volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a (7f583ebb-0fa3-4feb-b5ad-83a995b9893a): created successfully Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e30c6f-2890-4585-bdb6-6116660c15fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (9bfd08f6-34bf-44dc-a168-7e98d4825639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d84ca99c-d695-4862-98b4-ff73b4d69fe5 tempest-CreateVolumesFromImageTest-2119211847 None] Created volume successfully. Sep 23 00:34:39 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 1073741824" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 Sep 23 00:34:39 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f979570d-aa32-411f-9e85-15edc9759a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb69c63446f44095b9f4f55174c6e054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:36Z,use_quota=True,user_id='ca9dd0e8d2204003963a319ca103fa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Creating volume f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:40 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa87b89-40fb-4274-9c39-0e3aa32499cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:40 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1073741824 Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76048b6c-68e9-4349-9dac-9f3dcbf0536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:40 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Volume volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 (36aa67f3-080a-4b9d-93aa-4f59308d5db6): created successfully Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76048b6c-68e9-4349-9dac-9f3dcbf0536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Flow 'volume_create_manager' (18b7eb57-d4b8-417e-9807-91c025c62295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-42fd2267-2542-4a79-9146-ce00ffe02bb0 tempest-CreateVolumesFromImageTest-2119211847 None] Created volume successfully. Sep 23 00:34:40 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1073741824" returned: 0 in 0.573s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f Sep 23 00:34:40 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-36aa67f3-080a-4b9d-93aa-4f59308d5db6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-36aa67f3-080a-4b9d-93aa-4f59308d5db6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-quobyte-36aa67f3-080a-4b9d-93aa-4f59308d5db6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-36aa67f3-080a-4b9d-93aa-4f59308d5db6" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a4c3e7-bdae-4fd7-bd66-4b56a78ffcb4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f" returned: 0 in 0.335s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:41 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 Sep 23 00:34:41 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Attempting download of d60ae946-8e17-4bb1-a951-0d0e46f7748a ((None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}])) to volume f979570d-aa32-411f-9e85-15edc9759a5f. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266a0f6-a572-42c0-b215-64bc4abb8d1f]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy Sep 23 00:34:41 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6" returned: 0 in 0.498s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6 Sep 23 00:34:41 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:41 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy Sep 23 00:34:41 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:41 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-36aa67f3-080a-4b9d-93aa-4f59308d5db6" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-36aa67f3-080a-4b9d-93aa-4f59308d5db6" released by "delete_volume" :: held 0.899s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Created reservations ['bd35b938-982b-45cc-8e32-4fb93856690e', '6ddb620e-9795-4ea5-a118-07ed7d11acf9', '002b5f96-5604-4b19-aa12-f0ce5edf5740', 'a3b9c2f3-b86c-4541-b9b6-b980d142d23c', 'd9e7f2ab-04c7-4a98-b66c-a3ae918dea45'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:42 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy" returned: 1 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d60ae946-8e17-4bb1-a951-0d0e46f7748a_d0d3kbdy' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[73532e9b-46b3-4537-a784-90c9e51ed3bc]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:42 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:42 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Deleted volume successfully. Sep 23 00:34:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-60cf3412-8c41-47f7-a9dc-e27589b63eba tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-36aa67f3-080a-4b9d-93aa-4f59308d5db6-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:42 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD Sep 23 00:34:42 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD" returned: 1 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] d60ae946-8e17-4bb1-a951-0d0e46f7748a was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f Sep 23 00:34:43 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-7f583ebb-0fa3-4feb-b5ad-83a995b9893a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-7f583ebb-0fa3-4feb-b5ad-83a995b9893a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-quobyte-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ca4f3-084b-4f5a-8a34-a450262452aa]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a Sep 23 00:34:43 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f" returned: 0 in 0.621s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d60ae946-8e17-4bb1-a951-0d0e46f7748a_ex_5yi32devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:43 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1G Sep 23 00:34:43 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a Sep 23 00:34:43 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:44 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f 1G" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Downloaded image d60ae946-8e17-4bb1-a951-0d0e46f7748a ((None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}])) to volume f979570d-aa32-411f-9e85-15edc9759a5f successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Temporary image d60ae946-8e17-4bb1-a951-0d0e46f7748a for user ca9dd0e8d2204003963a319ca103fa0a is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Marking volume f979570d-aa32-411f-9e85-15edc9759a5f as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Copying metadata from image d60ae946-8e17-4bb1-a951-0d0e46f7748a to f979570d-aa32-411f-9e85-15edc9759a5f. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Creating volume glance metadata for volume f979570d-aa32-411f-9e85-15edc9759a5f backed by image d60ae946-8e17-4bb1-a951-0d0e46f7748a with: {'image_id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '315e1d4084bdeafc3fc4429d0d608657', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1f3753-84ea-4e0e-bd85-21f8eb3061a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f979570d-aa32-411f-9e85-15edc9759a5f', 'volume_size': 1, 'image_id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '315e1d4084bdeafc3fc4429d0d608657', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb69c63446f44095b9f4f55174c6e054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6955de188e3aa7a40afe331baa4eaba3980467684b9db9d80cc3fc6c867cb5d4850b4cd8a66bca37fd6be6fc2ef97c9b4499d4910139bec2c97c2c38b6f2e39', 'id': 'd60ae946-8e17-4bb1-a951-0d0e46f7748a', 'created_at': datetime.datetime(2026, 9, 22, 22, 34, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 34, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d60ae946-8e17-4bb1-a951-0d0e46f7748a/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242b906-b3c2-451e-9ed4-664e67d944f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Volume volume-f979570d-aa32-411f-9e85-15edc9759a5f (f979570d-aa32-411f-9e85-15edc9759a5f): created successfully Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242b906-b3c2-451e-9ed4-664e67d944f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Flow 'volume_create_manager' (33d481a3-f68f-418f-8824-3d68b3d8c188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-44b92267-adbd-4c29-a7ab-f349bc643d6b tempest-VolumeImageDependencyTests-1131862673 None] Created volume successfully. Sep 23 00:34:44 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-7f583ebb-0fa3-4feb-b5ad-83a995b9893a" released by "delete_volume" :: held 0.888s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Created reservations ['6c0b0793-bc11-4585-bedb-9631a742928a', '4e021207-c412-4eb7-a579-20492044990e', 'cc00c862-85f9-4003-908a-9fa9c5473658', '4faf1989-dfbb-46ff-9d01-b61ad0b6c64d', '87906e25-d69a-45ae-944e-30f3141ddf9d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:44 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:44 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:44 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Acquiring lock "cinder-f979570d-aa32-411f-9e85-15edc9759a5f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Deleted volume successfully. Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "cinder-f979570d-aa32-411f-9e85-15edc9759a5f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-55d0dd57-2799-490f-8f73-f69a7c04f112 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-7f583ebb-0fa3-4feb-b5ad-83a995b9893a-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Acquiring lock "cinder-quobyte-f979570d-aa32-411f-9e85-15edc9759a5f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "cinder-quobyte-f979570d-aa32-411f-9e85-15edc9759a5f" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d7f95-487d-4d6e-b16b-907ee422821d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f Sep 23 00:34:45 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f Sep 23 00:34:45 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f979570d-aa32-411f-9e85-15edc9759a5f" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-7138de1c-8bbd-406c-9aba-283cf2e2048f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "cinder-quobyte-f979570d-aa32-411f-9e85-15edc9759a5f" released by "delete_volume" :: held 0.719s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-7138de1c-8bbd-406c-9aba-283cf2e2048f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-quobyte-7138de1c-8bbd-406c-9aba-283cf2e2048f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-7138de1c-8bbd-406c-9aba-283cf2e2048f" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Created reservations ['f714acb5-a6ab-4bcd-8237-d6327c089ad6', 'c59484e5-c2af-4053-b7dd-52da01d25534', 'a98f6798-f757-4a02-b4ce-98524524df41', '4a7344ab-a0b3-4f3e-a80e-954700fe720d', '35114f38-8c5b-4b2c-8c8d-5448f852c283'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeabc861-7b5b-4875-9628-b81ecd4cf4ed]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:45 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f Sep 23 00:34:45 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Deleted volume successfully. Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-631ceff9-de93-4c2b-a126-b4acd0f3148c tempest-VolumeImageDependencyTests-1131862673 None] Lock "cinder-f979570d-aa32-411f-9e85-15edc9759a5f-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:46 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f Sep 23 00:34:46 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7138de1c-8bbd-406c-9aba-283cf2e2048f" returned: 0 in 0.316s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-7138de1c-8bbd-406c-9aba-283cf2e2048f" released by "delete_volume" :: held 0.810s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Created reservations ['740a46f4-d54a-412d-ae6d-fd0d9bb9b5b0', '1299ea87-d64b-4fd5-be96-e7e8097ee695', '3df9ceb1-481e-4775-ad7a-81d798c3a312', '23fa81a1-94e1-402d-9026-68162ac27bfc', 'ec4d7ef2-36bf-453c-9d9e-1059adb92112'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:46 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-adc00102-ce5f-4a16-816c-0ec649f7dd10-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-adc00102-ce5f-4a16-816c-0ec649f7dd10-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-quobyte-adc00102-ce5f-4a16-816c-0ec649f7dd10" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-adc00102-ce5f-4a16-816c-0ec649f7dd10" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb55a50e-08d7-4940-a446-f2eaa54f6524]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Deleted volume successfully. Sep 23 00:34:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9cfb8a95-b80f-4107-a7e6-9f617d1012c4 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-7138de1c-8bbd-406c-9aba-283cf2e2048f-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 Sep 23 00:34:47 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10" returned: 0 in 0.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10 Sep 23 00:34:47 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-adc00102-ce5f-4a16-816c-0ec649f7dd10" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-adc00102-ce5f-4a16-816c-0ec649f7dd10" released by "delete_volume" :: held 0.762s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Created reservations ['eff12cac-9bb7-4a27-a818-186cf8c84571', 'e78e8cc1-95b1-4b8b-918d-1765dfdb9d49', 'cf120a79-f681-4da5-84fb-ac2ee2ffe395', '187f04d3-7a18-4862-854f-cb64791d2cec', '886a0d48-3b43-4ec1-b98a-3b5c70076591'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:47 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "cinder-quobyte-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:48 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Deleted volume successfully. Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7fe520-ac26-4af0-b1c1-fccc521c5089]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fbb2d53-8482-4ba5-a87d-3952744649ec tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-adc00102-ce5f-4a16-816c-0ec649f7dd10-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:48 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 Sep 23 00:34:48 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74 Sep 23 00:34:48 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-quobyte-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74" released by "delete_volume" :: held 0.766s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:48 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Created reservations ['09c626b4-62b4-4b51-a9bb-83cfec9d37b8', '79f13024-b1cd-47ff-8ab6-71fd40d64550', 'c39bc867-ac6b-4527-9be1-870aece5c7ae', 'bf1fcd0e-1b6b-473b-8a8d-35dfdf36552f', 'c60302f7-9b36-4460-968a-25816b6eddb0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:49 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:49 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:49 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Deleted volume successfully. Sep 23 00:34:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-502cb3d8-b1e0-4438-8013-af13ba8fbcc9 tempest-CreateVolumesFromImageTest-2119211847 None] Lock "cinder-b0894b6d-f61f-44d9-bde8-b7bcf0eceb74-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=95,cinder:UPDATE=125,cinder:INSERT=40,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=107,cinder:UPDATE=122,cinder:INSERT=41,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Flow 'volume_create_manager' (9c1e8643-a2ea-47e9-9d79-fbf71035820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125c579-4445-41a7-958a-c911aecbd6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4125c579-4445-41a7-958a-c911aecbd6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435486182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ce7258d6314376998c30cacfe2d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:54Z,use_quota=True,user_id='2ed6103127964be5b722b35dc09ceb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529f6ad-47dd-4d0b-bead-ef6ab083dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529f6ad-47dd-4d0b-bead-ef6ab083dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daf9f27-9d2b-4ca1-85a9-b15cf4a68b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daf9f27-9d2b-4ca1-85a9-b15cf4a68b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd', 'volume_name': 'volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d5ebae-1824-431a-8568-b38726ed3c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d5ebae-1824-431a-8568-b38726ed3c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9c554-ef68-4af6-9756-32601876791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:53 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Volume 307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd', 'volume_size': 1} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435486182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ce7258d6314376998c30cacfe2d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:54Z,use_quota=True,user_id='2ed6103127964be5b722b35dc09ceb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Creating volume 307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:53 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:53 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd 1073741824 Sep 23 00:34:53 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:54 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd 1073741824" returned: 0 in 0.440s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:54 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd Sep 23 00:34:54 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:54 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9c554-ef68-4af6-9756-32601876791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c38309-1412-49a7-9569-9640e4a688b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Volume volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd (307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd): created successfully Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c38309-1412-49a7-9569-9640e4a688b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Flow 'volume_create_manager' (9c1e8643-a2ea-47e9-9d79-fbf71035820d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-33019837-a77e-4f11-a982-7e814b7c0643 tempest-ProjectReaderTests-672242860 None] Created volume successfully. Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Acquiring lock "cinder-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "cinder-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Acquiring lock "cinder-quobyte-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "cinder-quobyte-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb624f0-ee80-40c4-85f7-9f64d2b581f4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd Sep 23 00:34:56 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:56 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd Sep 23 00:34:56 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:56 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "cinder-quobyte-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd" released by "delete_volume" :: held 0.702s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Created reservations ['e9965018-f1e2-424b-b3e7-9af097ef1b68', 'e9a7bd75-2789-42ee-a4c4-ec1df12c5aad', '9974d435-7be4-45e9-a6e8-4a2e00079e31', '32b6c93e-5fac-4f8f-8fff-04f0ab9781b1', 'bd27bf16-9262-409f-85cf-5271271c0afc'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:56 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:56 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:57 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Deleted volume successfully. Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf6ee3d7-fbec-4904-ac38-c91378f2619c tempest-ProjectReaderTests-672242860 None] Lock "cinder-307d5ba4-9ab3-4af1-bee4-cbd8bd4c8acd-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Flow 'volume_create_manager' (c33672d9-672e-496c-82a6-ac39b5556ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b154a1-424a-40cd-bac9-7927e51a54e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b154a1-424a-40cd-bac9-7927e51a54e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731713290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7793a4-f6f7-4c08-807f-ed8a50c44f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ce7258d6314376998c30cacfe2d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='2ed6103127964be5b722b35dc09ceb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c7f614-def5-47d8-95fc-7bf7a2376eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c7f614-def5-47d8-95fc-7bf7a2376eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c45ea2b-c10f-42cd-9045-e70fe5ddf600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c45ea2b-c10f-42cd-9045-e70fe5ddf600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7793a4-f6f7-4c08-807f-ed8a50c44f2e', 'volume_name': 'volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b344767-2ed4-49df-bef6-71dbce2c09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b344767-2ed4-49df-bef6-71dbce2c09b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac868112-489f-4bdb-8570-4ad754c2375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Volume ef7793a4-f6f7-4c08-807f-ed8a50c44f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e', 'volume_size': 1} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731713290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7793a4-f6f7-4c08-807f-ed8a50c44f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97ce7258d6314376998c30cacfe2d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:58Z,use_quota=True,user_id='2ed6103127964be5b722b35dc09ceb5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Creating volume ef7793a4-f6f7-4c08-807f-ed8a50c44f2e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:57 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e 1073741824 Sep 23 00:34:57 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:58 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e 1073741824" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:58 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e Sep 23 00:34:58 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:58 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac868112-489f-4bdb-8570-4ad754c2375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2f8fb-e99a-494a-9f3a-4f0d7a838a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Volume volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e (ef7793a4-f6f7-4c08-807f-ed8a50c44f2e): created successfully Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b2f8fb-e99a-494a-9f3a-4f0d7a838a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Flow 'volume_create_manager' (c33672d9-672e-496c-82a6-ac39b5556ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a03ad166-fcca-4140-98b9-645d94db1702 tempest-ProjectReaderTests-672242860 None] Created volume successfully. Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Acquiring lock "cinder-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "cinder-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Acquiring lock "cinder-quobyte-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "cinder-quobyte-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" acquired by "delete_volume" :: waited 0.067s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc9912-2da5-41f3-bf26-be5124ba045b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:58 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e Sep 23 00:34:58 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:59 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:59 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e Sep 23 00:34:59 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:59 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "cinder-quobyte-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e" released by "delete_volume" :: held 0.805s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Created reservations ['5bae12e7-2c74-4588-8fdf-2efd267934a7', 'f03ecede-2f08-41f4-b4bc-9a5f448bd743', '59ea2620-f305-4aec-a301-bdca43e3cf06', 'db05ad64-6095-44cf-b254-41e46eefe78d', '6e7a9c58-395d-4ca0-8eab-60bce3951f43'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:59 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:34:59 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:00 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Deleted volume successfully. Sep 23 00:35:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-972a1613-617a-4475-9a65-5ac5324dde36 tempest-ProjectReaderTests-672242860 None] Lock "cinder-ef7793a4-f6f7-4c08-807f-ed8a50c44f2e-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:09 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=27,cinder:SELECT=15,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:10 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Flow 'volume_create_manager' (b48ccebb-d157-4896-81c4-301e7b37d0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3446b7b9-24b5-4cab-bf49-4a1a9941b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3446b7b9-24b5-4cab-bf49-4a1a9941b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1870677157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6777123e-2a00-452d-82f3-176af72239dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb2a167c8794d19bb96c18248b5b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:31Z,use_quota=True,user_id='34787b548d0146cba331e5dbb8e8e2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e127e9bc-990d-48cb-920a-ccabf52e799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e127e9bc-990d-48cb-920a-ccabf52e799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd91184a-7c75-42fa-bf72-84a5785e9ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd91184a-7c75-42fa-bf72-84a5785e9ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6777123e-2a00-452d-82f3-176af72239dc', 'volume_name': 'volume-6777123e-2a00-452d-82f3-176af72239dc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5f2248-a127-451f-982d-24d9b46ba0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5f2248-a127-451f-982d-24d9b46ba0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3197861a-4b43-46e6-9b18-9d69ac9eb70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Volume 6777123e-2a00-452d-82f3-176af72239dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6777123e-2a00-452d-82f3-176af72239dc', 'volume_size': 1} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1870677157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6777123e-2a00-452d-82f3-176af72239dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb2a167c8794d19bb96c18248b5b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:31Z,use_quota=True,user_id='34787b548d0146cba331e5dbb8e8e2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Creating volume 6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc 1073741824 Sep 23 00:35:31 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc 1073741824" returned: 0 in 0.434s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:31 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:31 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:31 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3197861a-4b43-46e6-9b18-9d69ac9eb70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6777123e-2a00-452d-82f3-176af72239dc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4313396-913e-47ca-9011-00be479e91a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Volume volume-6777123e-2a00-452d-82f3-176af72239dc (6777123e-2a00-452d-82f3-176af72239dc): created successfully Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4313396-913e-47ca-9011-00be479e91a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Flow 'volume_create_manager' (b48ccebb-d157-4896-81c4-301e7b37d0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4f0eb7ef-1bc5-408c-a13c-838e02e5d3d5 tempest-SnapshotDependencyTests-1448510259 None] Created volume successfully. Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Creating offline snapshot 680e0b1d-e042-4889-accc-99cc0b5187c2 of volume 6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae38f6-3c4b-4573-bf33-2c1332d1681c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:32 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 1G Sep 23 00:35:32 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 1G" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6777123e-2a00-452d-82f3-176af72239dc -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6777123e-2a00-452d-82f3-176af72239dc -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:33 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6777123e-2a00-452d-82f3-176af72239dc -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 is being set with open permissions: ugo+rw Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:33 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info Sep 23 00:35:33 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info is being set with open permissions: ugo+rw Sep 23 00:35:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:33 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info Sep 23 00:35:33 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:34 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.info" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aa6d8fef-c0e3-42b5-b67d-744ee4450a18 tempest-SnapshotDependencyTests-1448510259 None] Create snapshot completed successfully Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Flow 'volume_create_manager' (e177ac6a-37bd-4bf4-b700-5ebef053efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619044c8-19c6-49e5-ad5b-626cca7cb34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619044c8-19c6-49e5-ad5b-626cca7cb34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf41203-f4ad-446d-9197-b07b16778b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb2a167c8794d19bb96c18248b5b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=680e0b1d-e042-4889-accc-99cc0b5187c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:35Z,use_quota=True,user_id='34787b548d0146cba331e5dbb8e8e2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fee231e-a59e-429d-af3f-04c5a83c1ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fee231e-a59e-429d-af3f-04c5a83c1ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b3850a-59ee-497b-bd14-de54b449b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b3850a-59ee-497b-bd14-de54b449b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fbf41203-f4ad-446d-9197-b07b16778b4c', 'volume_name': 'volume-fbf41203-f4ad-446d-9197-b07b16778b4c', 'volume_size': 1, 'snapshot_id': '680e0b1d-e042-4889-accc-99cc0b5187c2'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae19aaf-ccb0-47dc-97db-31f4bacee1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae19aaf-ccb0-47dc-97db-31f4bacee1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b1c917-f7e6-4530-b678-d56fb69e3333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Volume fbf41203-f4ad-446d-9197-b07b16778b4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fbf41203-f4ad-446d-9197-b07b16778b4c', 'volume_size': 1, 'snapshot_id': '680e0b1d-e042-4889-accc-99cc0b5187c2'} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2-fbf41203-f4ad-446d-9197-b07b16778b4c" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2-fbf41203-f4ad-446d-9197-b07b16778b4c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Creating volume fbf41203-f4ad-446d-9197-b07b16778b4c from snapshot 680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] snapshot: 680e0b1d-e042-4889-accc-99cc0b5187c2, volume: fbf41203-f4ad-446d-9197-b07b16778b4c, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c274849-e394-4523-bb64-3e9312480bc9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:35 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6777123e-2a00-452d-82f3-176af72239dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73b4768-6f60-4d42-9358-3e412c53580a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:35 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:36 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:35:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:35:36 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:35:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:36 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c Sep 23 00:35:36 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:35:37 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:35:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:35:41 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c" returned: 0 in 5.651s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:41 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Converted 1024.00 MB image at 181.15 MB/s Sep 23 00:35:41 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c is being set with open permissions: ugo+rw Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:41 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c Sep 23 00:35:41 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" released by "_copy_volume_from_snapshot" :: held 6.716s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2-fbf41203-f4ad-446d-9197-b07b16778b4c" released by "_create_volume_from_snapshot" :: held 6.776s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.795s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b1c917-f7e6-4530-b678-d56fb69e3333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf41203-f4ad-446d-9197-b07b16778b4c', 'volume_size': 1, 'snapshot_id': '680e0b1d-e042-4889-accc-99cc0b5187c2'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be4a08-986a-4a1c-9123-6c55e60c4f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Volume volume-fbf41203-f4ad-446d-9197-b07b16778b4c (fbf41203-f4ad-446d-9197-b07b16778b4c): created successfully Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be4a08-986a-4a1c-9123-6c55e60c4f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Flow 'volume_create_manager' (e177ac6a-37bd-4bf4-b700-5ebef053efce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cbf84e44-e1d1-4302-9344-69506b3780fa tempest-SnapshotDependencyTests-1448510259 None] Created volume successfully. Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-680e0b1d-e042-4889-accc-99cc0b5187c2-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-680e0b1d-e042-4889-accc-99cc0b5187c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Deleting offline snapshot 680e0b1d-e042-4889-accc-99cc0b5187c2 of volume 6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] snapshot_file for this snap is: volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[93de5f11-da76-42b8-8153-84781d977f31]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:42 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:42 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:43 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6777123e-2a00-452d-82f3-176af72239dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d998ece7-151a-44a9-b816-4b9af39fde2d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:43 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:43 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:43 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:43 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:43 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.386s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:44 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2 Sep 23 00:35:44 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc.680e0b1d-e042-4889-accc-99cc0b5187c2" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-680e0b1d-e042-4889-accc-99cc0b5187c2" released by "_delete_snapshot" :: held 1.697s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" released by "delete_snapshot" :: held 1.720s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Created reservations ['b1da6794-7d37-46d4-882d-788535209833', '958eed56-dbdc-41e3-b5d2-bc6a454d046e', '786f62e1-93d2-40d3-b1c7-d03c154fb28e', 'f8b966e3-fd5b-46a8-a421-d8eeecf8ebdd', 'bd4e3be9-4bef-4043-81da-f99d4fef7666'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:35:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Delete snapshot completed successfully. Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f912dd63-a0ec-414a-ba1b-6af754f3c35f tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-680e0b1d-e042-4889-accc-99cc0b5187c2-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-6777123e-2a00-452d-82f3-176af72239dc-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-6777123e-2a00-452d-82f3-176af72239dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0cc23-e355-4386-b4e4-a75689462d28]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:45 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc Sep 23 00:35:45 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-6777123e-2a00-452d-82f3-176af72239dc" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-6777123e-2a00-452d-82f3-176af72239dc" released by "delete_volume" :: held 0.697s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Created reservations ['b1169b06-c44e-4ec2-878e-e9d7d33bbd50', 'f7a35368-c043-4cd3-a668-349ca47f50fd', '46e9d1df-7d26-440e-8b76-720bcbd606ed', '7dcb6e7a-4c96-4a3f-bea9-7da826d5eaac', 'fec8f769-75e8-4758-824e-530e80d5b85a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:35:45 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Deleted volume successfully. Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0f660ff-4cea-40dd-9161-5b556fbb07ac tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-6777123e-2a00-452d-82f3-176af72239dc-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-fbf41203-f4ad-446d-9197-b07b16778b4c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-fbf41203-f4ad-446d-9197-b07b16778b4c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead994b8-ad74-4df5-b8b8-d5463dfda472]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c Sep 23 00:35:46 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c Sep 23 00:35:46 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fbf41203-f4ad-446d-9197-b07b16778b4c" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-quobyte-fbf41203-f4ad-446d-9197-b07b16778b4c" released by "delete_volume" :: held 0.718s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Created reservations ['fcddf389-025c-4de0-a1ce-f68f4d1076ce', '791b5f92-e33b-4f6b-a030-939115bb6511', '4bc10ce5-6d31-4a79-ade6-6a6a8e2fee2c', '20a6f469-8bee-402b-8067-3f8fb4a228cc', 'aa186769-fd0d-4dd3-b391-2729e0157fb5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:47 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:35:47 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:47 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Deleted volume successfully. Sep 23 00:35:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-504d818b-ccae-4f59-bde4-e725423b4ed0 tempest-SnapshotDependencyTests-1448510259 None] Lock "cinder-fbf41203-f4ad-446d-9197-b07b16778b4c-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=31,cinder:INSERT=12,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=37,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Flow 'volume_create_manager' (b949de3e-4214-41fb-b59d-0d636a416fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254164b-3c11-4bb4-b8e5-6b04b82b2b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254164b-3c11-4bb4-b8e5-6b04b82b2b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1347885684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0122b2b-01c3-4ed4-9412-db1d4c13fe55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94cdaacd37420fa66f0a2d581d7ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:13Z,use_quota=True,user_id='d06ef116f51645aaa8fa4a08c0194356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaf5e15-11fd-4f4b-9fce-f0d24ff7f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baaf5e15-11fd-4f4b-9fce-f0d24ff7f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec516575-fc9f-4ade-8065-73ed434334bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec516575-fc9f-4ade-8065-73ed434334bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0122b2b-01c3-4ed4-9412-db1d4c13fe55', 'volume_name': 'volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6d319e-ae84-4f42-9f9b-af380cfab007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6d319e-ae84-4f42-9f9b-af380cfab007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23e99a3-99d3-4d24-9a05-50956c4d0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Volume d0122b2b-01c3-4ed4-9412-db1d4c13fe55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55', 'volume_size': 1} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1347885684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0122b2b-01c3-4ed4-9412-db1d4c13fe55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94cdaacd37420fa66f0a2d581d7ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:13Z,use_quota=True,user_id='d06ef116f51645aaa8fa4a08c0194356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Creating volume d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 1073741824 Sep 23 00:36:13 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 1073741824" returned: 0 in 0.636s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:14 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:14 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (087412a4-77d8-4bf3-8018-882c82ca4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843dc638-59bb-4cb8-a4b3-45e80dca22d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843dc638-59bb-4cb8-a4b3-45e80dca22d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177345118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e846586d-7b01-43f3-ae1f-362a95d9481b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:14Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2962167-db7d-498a-a813-dd6067c4a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2962167-db7d-498a-a813-dd6067c4a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c6329-01df-475f-b167-cdd7a2be75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c6329-01df-475f-b167-cdd7a2be75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e846586d-7b01-43f3-ae1f-362a95d9481b', 'volume_name': 'volume-e846586d-7b01-43f3-ae1f-362a95d9481b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce5c964-1f2f-454c-9a9a-4979369c5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce5c964-1f2f-454c-9a9a-4979369c5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172e2cd0-e2d2-49bf-aee3-3dc97f2067ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume e846586d-7b01-43f3-ae1f-362a95d9481b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e846586d-7b01-43f3-ae1f-362a95d9481b', 'volume_size': 1} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:14 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177345118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e846586d-7b01-43f3-ae1f-362a95d9481b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:14Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:14 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:14 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b 1073741824 Sep 23 00:36:14 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23e99a3-99d3-4d24-9a05-50956c4d0396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1026bde0-3f88-4cfd-8b2b-3d50cf5d0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Volume volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 (d0122b2b-01c3-4ed4-9412-db1d4c13fe55): created successfully Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1026bde0-3f88-4cfd-8b2b-3d50cf5d0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Flow 'volume_create_manager' (b949de3e-4214-41fb-b59d-0d636a416fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-71d420d6-80aa-415c-9bac-23a7f28c05df tempest-VolumeDependencyTests-53786138 None] Created volume successfully. Sep 23 00:36:15 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b 1073741824" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b Sep 23 00:36:15 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:15 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b" returned: 0 in 0.316s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172e2cd0-e2d2-49bf-aee3-3dc97f2067ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e846586d-7b01-43f3-ae1f-362a95d9481b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fce389b-b1a8-4ba0-825b-c399aecad241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-e846586d-7b01-43f3-ae1f-362a95d9481b (e846586d-7b01-43f3-ae1f-362a95d9481b): created successfully Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fce389b-b1a8-4ba0-825b-c399aecad241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (087412a4-77d8-4bf3-8018-882c82ca4c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a151a777-d385-42e4-8223-10171a06fff6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Creating offline snapshot 0df4d0ce-7455-452f-bb7b-3bf085bb39ed of volume d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a12f57b-f321-4bdd-b6c0-4c3f858f4b35]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:15 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:16 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed 1G Sep 23 00:36:16 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:16 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Flow 'volume_create_manager' (8a2dec65-78dd-48ae-adbf-6dbc1f32ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6afc3c-78ef-4287-a008-327400338d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed 1G" returned: 0 in 0.577s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6afc3c-78ef-4287-a008-327400338d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edbf3bc-ba1c-49e8-bd1a-fada75a448ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfc835a57154be9a3071fa691aed601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:17Z,use_quota=True,user_id='5b6a6a8757ed4645900a2e314d74518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:16 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:16 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb9d506-6f0b-4854-89c3-30fdf7e3d73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb9d506-6f0b-4854-89c3-30fdf7e3d73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276c56e6-df20-4071-a16c-fcd1a31295d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:16 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276c56e6-df20-4071-a16c-fcd1a31295d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7edbf3bc-ba1c-49e8-bd1a-fada75a448ba', 'volume_name': 'volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba', 'volume_size': 1, 'image_id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '525e15a7fd767c35947e7d2f980d436a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bfc835a57154be9a3071fa691aed601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a14b7865b2d043b54576b4fad606d76edfc05ee2d22f3f2ce4564b016fd5208758b99c461b56432dc46aa179a9dc690c0ff1a40a89d010a4304b75594ad7a3a6', 'id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a29ded3-125c-4d30-bfe4-241aebfe3741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a29ded3-125c-4d30-bfe4-241aebfe3741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558e5dfa-182f-46c9-aeb2-c60ecc1d1088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba', 'volume_size': 1, 'image_id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '525e15a7fd767c35947e7d2f980d436a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bfc835a57154be9a3071fa691aed601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a14b7865b2d043b54576b4fad606d76edfc05ee2d22f3f2ce4564b016fd5208758b99c461b56432dc46aa179a9dc690c0ff1a40a89d010a4304b75594ad7a3a6', 'id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7/file', 'properties': {}}, 'image_service': } Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Trying to clone 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba from image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:36:17 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed is being set with open permissions: ugo+rw Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:17 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:36:17 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f2c562-7bb4-45b8-96b8-3b21c6f277ef]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:17 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info Sep 23 00:36:17 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info is being set with open permissions: ugo+rw Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:17 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info Sep 23 00:36:17 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Flow 'volume_create_manager' (7baab83d-beaf-45fb-a731-9b3385df1789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48207dfa-3dd3-4a29-a247-6574e888932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48207dfa-3dd3-4a29-a247-6574e888932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcca8a5-44d1-47a2-825f-c428f7a910c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b407955f345059c596531e13c375c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:18Z,use_quota=True,user_id='9057737caa6f4fbe835349fed45fe9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73684dcb-293b-4682-860b-3467989b6e04),volume_type_id=73684dcb-293b-4682-860b-3467989b6e04)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64751824-e757-4437-84b6-d1c10691ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64751824-e757-4437-84b6-d1c10691ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f5e046-c459-4736-8017-10473477e97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:36:18 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Temporary image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 is fetched for user 5b6a6a8757ed4645900a2e314d74518b. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:36:18 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.info" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.398s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating offline snapshot e21bead2-0ff3-4235-8a19-a3755a914a74 of volume e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce13e20-8b1e-4601-b53f-af334698985a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7b87a8c0-b4d3-4f45-8f50-a5fe0dbd2ab8 tempest-VolumeDependencyTests-53786138 None] Create snapshot completed successfully Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa0d44-2644-435a-b2f3-bbdd850fe55f]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f5e046-c459-4736-8017-10473477e97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bcca8a5-44d1-47a2-825f-c428f7a910c3', 'volume_name': 'volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3', 'volume_size': 1, 'image_id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fa2b2f56828e08e6e74a8f5962cb124', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f7b407955f345059c596531e13c375c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a37c0f5ccc35cc0d89b6fe7af5cbdc2d88bea2068ff6c8ee209881180fba5867c085cf89a261f7ed12a359de59c1158e387fcd2fcf5ad2872b54bbdd8fab4e14', 'id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a050b227-0ef0-4ddc-8756-7c6b59831dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a050b227-0ef0-4ddc-8756-7c6b59831dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1cc6b5-dd67-4514-ac1e-93c0de45afbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3', 'volume_size': 1, 'image_id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fa2b2f56828e08e6e74a8f5962cb124', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f7b407955f345059c596531e13c375c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a37c0f5ccc35cc0d89b6fe7af5cbdc2d88bea2068ff6c8ee209881180fba5867c085cf89a261f7ed12a359de59c1158e387fcd2fcf5ad2872b54bbdd8fab4e14', 'id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Trying to clone 0bcca8a5-44d1-47a2-825f-c428f7a910c3 from image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:36:18 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b Sep 23 00:36:18 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:18 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:36:18 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1496329b-d778-43af-a06f-65b8d16f71e1]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:18 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 1G Sep 23 00:36:18 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:18 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:18 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:19 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 1G" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e846586d-7b01-43f3-ae1f-362a95d9481b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Temporary image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb is fetched for user 9057737caa6f4fbe835349fed45fe9f3. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:36:19 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e846586d-7b01-43f3-ae1f-362a95d9481b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 Sep 23 00:36:19 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[538de4e3-faa2-45be-90f6-df07ec5e405b]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:19 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e846586d-7b01-43f3-ae1f-362a95d9481b -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 is being set with open permissions: ugo+rw Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 Sep 23 00:36:19 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Flow 'volume_create_manager' (2f1a9b52-d7fc-4578-9c4b-b05ef472e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991f4417-7029-42f3-862b-ba6d458fa45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991f4417-7029-42f3-862b-ba6d458fa45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2079460297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a8ee4b-9b68-4512-aaf0-170390bd0b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d94cdaacd37420fa66f0a2d581d7ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0df4d0ce-7455-452f-bb7b-3bf085bb39ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:20Z,use_quota=True,user_id='d06ef116f51645aaa8fa4a08c0194356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ba07f9-bfe0-4730-aef0-b8b06ef3cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ba07f9-bfe0-4730-aef0-b8b06ef3cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6760f0e8-6af3-4c01-b023-7d3416aa7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:19 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6760f0e8-6af3-4c01-b023-7d3416aa7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7a8ee4b-9b68-4512-aaf0-170390bd0b30', 'volume_name': 'volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30', 'volume_size': 1, 'snapshot_id': '0df4d0ce-7455-452f-bb7b-3bf085bb39ed'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bce017-dbb7-47b2-b663-a2ee3ad4a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bce017-dbb7-47b2-b663-a2ee3ad4a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182b1b47-6932-414a-8b1e-173ca298b709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Volume c7a8ee4b-9b68-4512-aaf0-170390bd0b30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30', 'volume_size': 1, 'snapshot_id': '0df4d0ce-7455-452f-bb7b-3bf085bb39ed'} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:19 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:19 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info Sep 23 00:36:19 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:20 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:20 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info is being set with open permissions: ugo+rw Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:20 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info Sep 23 00:36:20 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:20 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.info" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edbf3bc-ba1c-49e8-bd1a-fada75a448ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bfc835a57154be9a3071fa691aed601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:17Z,use_quota=True,user_id='5b6a6a8757ed4645900a2e314d74518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Creating volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:20 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1073741824 Sep 23 00:36:20 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9b5470c0-fca8-4658-9446-dd781e706237 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Create snapshot completed successfully Sep 23 00:36:21 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1073741824" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:21 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba Sep 23 00:36:21 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:21 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.502s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Creating volume c7a8ee4b-9b68-4512-aaf0-170390bd0b30 from snapshot 0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Attempting download of b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}])) to volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] snapshot: 0df4d0ce-7455-452f-bb7b-3bf085bb39ed, volume: c7a8ee4b-9b68-4512-aaf0-170390bd0b30, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[956fc30e-d345-42ed-bd3e-6986bcbb9046]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ecc60e-2607-49f3-90a9-903d4ee65f85]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (97f334ac-a2e4-40d2-9d8a-3fce58e832e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c150dc-9b74-4a22-970b-d71735167694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c150dc-9b74-4a22-970b-d71735167694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093256870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f460ad-ae72-4246-b312-642755047e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:21Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd5394-ab8a-4174-8c63-ef32999ff959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:21 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dd5394-ab8a-4174-8c63-ef32999ff959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d46e61-4328-4606-b71b-c76b94cc7591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d46e61-4328-4606-b71b-c76b94cc7591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f460ad-ae72-4246-b312-642755047e81', 'volume_name': 'volume-f0f460ad-ae72-4246-b312-642755047e81', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:21 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u Sep 23 00:36:21 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ea66ef-6b4a-4440-99db-0d35fb560762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ea66ef-6b4a-4440-99db-0d35fb560762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b2bb81-92ad-4ffa-b224-98cfce3131bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume f0f460ad-ae72-4246-b312-642755047e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f460ad-ae72-4246-b312-642755047e81', 'volume_size': 1} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:21 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:21 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (a66712c5-3a1d-4c10-952a-a19e3709ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadaa59-18e0-4141-a6cb-fdebb285f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadaa59-18e0-4141-a6cb-fdebb285f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991824404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c63cab-3ad2-4a33-84ec-1c88ded4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42de016-a225-43c4-93a1-b4072deb61e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42de016-a225-43c4-93a1-b4072deb61e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e439e-3d01-4256-bd0a-eff48edd763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e439e-3d01-4256-bd0a-eff48edd763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c63cab-3ad2-4a33-84ec-1c88ded4987e', 'volume_name': 'volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa450f-14d1-4682-b825-44623447cc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa450f-14d1-4682-b825-44623447cc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0207f379-7a59-4f0d-80e6-0aa6260fb57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume c4c63cab-3ad2-4a33-84ec-1c88ded4987e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e', 'volume_size': 1} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e4b2c-7648-4423-beac-c8e5d9800a41]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u Sep 23 00:36:22 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:22 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:22 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (7b688fbf-35e3-4c59-a15e-3ae42c51ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958ee656-8336-42c5-a5e5-6e9a1db678f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u" returned: 1 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_dvmpxw_u' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55863f3f-0198-4a93-9e01-fc707742b84f]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958ee656-8336-42c5-a5e5-6e9a1db678f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999418740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb58dfe-ae50-449c-a8ba-b82cd9be2418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c422d14b-98cb-436f-859e-bab2a5792286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c422d14b-98cb-436f-859e-bab2a5792286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109ef588-5f60-4055-92b0-5ffa12033f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109ef588-5f60-4055-92b0-5ffa12033f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb58dfe-ae50-449c-a8ba-b82cd9be2418', 'volume_name': 'volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7f0de9-2498-4dc2-93bd-5a024fc34625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7f0de9-2498-4dc2-93bd-5a024fc34625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9aa703-d378-42d6-9b95-431f8e1fb8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume 3bb58dfe-ae50-449c-a8ba-b82cd9be2418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418', 'volume_size': 1} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 Sep 23 00:36:22 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:22 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (88e2700a-2e82-46cf-9b0d-92ff575b2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3cce1d-c5fb-4b19-8e73-010b8e02a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3cce1d-c5fb-4b19-8e73-010b8e02a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730951407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:23Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dab61f8-6bda-4dbc-ab26-a521ab5e4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dab61f8-6bda-4dbc-ab26-a521ab5e4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1a4a31-b2a2-4b80-8dfb-be0708ddf96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1a4a31-b2a2-4b80-8dfb-be0708ddf96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a', 'volume_name': 'volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8287b233-be9a-47cf-9272-f446562b2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8287b233-be9a-47cf-9272-f446562b2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a1b572-9620-40cc-8f0b-0aa0ff630682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume 2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a', 'volume_size': 1} Sep 23 00:36:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:23 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD Sep 23 00:36:23 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:23 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD" returned: 1 in 0.604s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:23 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba Sep 23 00:36:23 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (1e86658b-b733-4bd5-b987-ed991531b7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49352283-2de9-4cec-8a45-41f1b1b3aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49352283-2de9-4cec-8a45-41f1b1b3aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314334483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eeda75-948c-4ab7-a384-7661d3e3e229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feae06f-6363-4766-aad2-4105eb5d5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1feae06f-6363-4766-aad2-4105eb5d5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c13295-aafc-4ec4-a4be-f8c21322ec18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c13295-aafc-4ec4-a4be-f8c21322ec18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41eeda75-948c-4ab7-a384-7661d3e3e229', 'volume_name': 'volume-41eeda75-948c-4ab7-a384-7661d3e3e229', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b88d08-3379-4157-86b5-f1d55760a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b88d08-3379-4157-86b5-f1d55760a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03c5a40-d62a-4629-9146-d526b9dde7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume 41eeda75-948c-4ab7-a384-7661d3e3e229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41eeda75-948c-4ab7-a384-7661d3e3e229', 'volume_size': 1} Sep 23 00:36:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:24 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" returned: 0 in 0.981s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7_wdstsm7tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:24 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:36:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1G Sep 23 00:36:24 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:25 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba 1G" returned: 0 in 0.805s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Downloaded image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}])) to volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Temporary image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 for user 5b6a6a8757ed4645900a2e314d74518b is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Marking volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Copying metadata from image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 to 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Creating volume glance metadata for volume 7edbf3bc-ba1c-49e8-bd1a-fada75a448ba backed by image b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7 with: {'image_id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '525e15a7fd767c35947e7d2f980d436a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558e5dfa-182f-46c9-aeb2-c60ecc1d1088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba', 'volume_size': 1, 'image_id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '525e15a7fd767c35947e7d2f980d436a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bfc835a57154be9a3071fa691aed601', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a14b7865b2d043b54576b4fad606d76edfc05ee2d22f3f2ce4564b016fd5208758b99c461b56432dc46aa179a9dc690c0ff1a40a89d010a4304b75594ad7a3a6', 'id': 'b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1f33a1f-ccf1-48eb-b29d-c7c6037e9eb7/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17b25c3-d74e-4971-8e78-e4036b871270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Volume volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba (7edbf3bc-ba1c-49e8-bd1a-fada75a448ba): created successfully Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17b25c3-d74e-4971-8e78-e4036b871270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Flow 'volume_create_manager' (8a2dec65-78dd-48ae-adbf-6dbc1f32ec11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2b862a3c-6776-4bdf-a87c-9d5d54a183a8 tempest-VolumeImageDependencyTests-1028915473 None] Created volume successfully. Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Acquiring lock "cinder-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "cinder-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Acquiring lock "cinder-quobyte-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "cinder-quobyte-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f7ff7d-1e84-4bb7-b363-e89bd861d980]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba Sep 23 00:36:27 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:27 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba Sep 23 00:36:27 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:27 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "cinder-quobyte-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba" released by "delete_volume" :: held 0.958s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:27 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Created reservations ['f75cb789-6ace-478d-b0bd-9fe38dd15c7f', '25679535-9724-4d9c-ac9f-c68e1286c0c0', '50b66551-4396-4926-86dd-5d0823739f81', '5487d166-f682-4947-a8c4-c90cf25239fe', '93dd6d76-7c9e-4fda-a826-b72025cc6da2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:28 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Deleted volume successfully. Sep 23 00:36:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-702a3382-0dc3-4465-90c2-da3e944d9678 tempest-VolumeImageDependencyTests-1028915473 None] Lock "cinder-7edbf3bc-ba1c-49e8-bd1a-fada75a448ba-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:29 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" returned: 0 in 6.700s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:29 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Converted 1024.00 MB image at 152.80 MB/s Sep 23 00:36:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 is being set with open permissions: ugo+rw Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 Sep 23 00:36:29 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" released by "_copy_volume_from_snapshot" :: held 8.107s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" released by "_create_volume_from_snapshot" :: held 8.181s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.212s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.387s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcca8a5-44d1-47a2-825f-c428f7a910c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b407955f345059c596531e13c375c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:18Z,use_quota=True,user_id='9057737caa6f4fbe835349fed45fe9f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73684dcb-293b-4682-860b-3467989b6e04),volume_type_id=73684dcb-293b-4682-860b-3467989b6e04)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Creating volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:29 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:29 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1073741824 Sep 23 00:36:29 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182b1b47-6932-414a-8b1e-173ca298b709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30', 'volume_size': 1, 'snapshot_id': '0df4d0ce-7455-452f-bb7b-3bf085bb39ed'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0387e5dc-5422-44a7-863f-487b6a9fc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Volume volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 (c7a8ee4b-9b68-4512-aaf0-170390bd0b30): created successfully Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0387e5dc-5422-44a7-863f-487b6a9fc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Flow 'volume_create_manager' (2f1a9b52-d7fc-4578-9c4b-b05ef472e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-36cc581a-3157-4166-89bf-da8ff7ee7b50 tempest-VolumeDependencyTests-53786138 None] Created volume successfully. Sep 23 00:36:30 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1073741824" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 Sep 23 00:36:30 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.692s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093256870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f460ad-ae72-4246-b312-642755047e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:21Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume f0f460ad-ae72-4246-b312-642755047e81 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:30 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 1073741824 Sep 23 00:36:30 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Attempting download of b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb ((None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}])) to volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a90bf1a-5ce4-4bc9-ae42-ef39c3047333]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k Sep 23 00:36:30 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Deleting offline snapshot 0df4d0ce-7455-452f-bb7b-3bf085bb39ed of volume d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] snapshot_file for this snap is: volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd795f4-ae7f-4793-b4ce-6eb71daf3b42]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:30 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:30 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:30 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 1073741824" returned: 0 in 0.670s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 Sep 23 00:36:31 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k Sep 23 00:36:31 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4817fe-457f-4c53-a2e1-3b16071e56a1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k" returned: 1 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_npc6ym6k' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:31 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a9b54-7e8a-4b23-be80-7176f4fd4ede]: (4, 'raw') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:31 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:31 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.366s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991824404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c63cab-3ad2-4a33-84ec-1c88ded4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume c4c63cab-3ad2-4a33-84ec-1c88ded4987e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b2bb81-92ad-4ffa-b224-98cfce3131bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f460ad-ae72-4246-b312-642755047e81', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e 1073741824 Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db605073-1a10-442d-97c1-5f8ad62f9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:31 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-f0f460ad-ae72-4246-b312-642755047e81 (f0f460ad-ae72-4246-b312-642755047e81): created successfully Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db605073-1a10-442d-97c1-5f8ad62f9bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (97f334ac-a2e4-40d2-9d8a-3fce58e832e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-edc59c7b-9160-4819-a7b4-4f14f61c4ce2 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:31 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:31 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:31 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:31 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.699s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD Sep 23 00:36:32 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:32 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e 1073741824" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e Sep 23 00:36:32 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 Sep 23 00:36:32 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.985s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999418740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb58dfe-ae50-449c-a8ba-b82cd9be2418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:22Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume 3bb58dfe-ae50-449c-a8ba-b82cd9be2418 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 1073741824 Sep 23 00:36:32 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0207f379-7a59-4f0d-80e6-0aa6260fb57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6001cae-786f-4cc7-b573-f853516194e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.592s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e (c4c63cab-3ad2-4a33-84ec-1c88ded4987e): created successfully Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6001cae-786f-4cc7-b573-f853516194e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (a66712c5-3a1d-4c10-952a-a19e3709ae97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:32 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed Sep 23 00:36:32 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b5f76446-0b15-4d05-aebf-119d25805b2a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:32 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3" returned: 0 in 0.623s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb_85p23qljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:32 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:36:32 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55.0df4d0ce-7455-452f-bb7b-3bf085bb39ed" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1G Sep 23 00:36:32 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-0df4d0ce-7455-452f-bb7b-3bf085bb39ed" released by "_delete_snapshot" :: held 2.277s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" released by "delete_snapshot" :: held 2.314s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 1073741824" returned: 0 in 0.553s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Created reservations ['b957e03a-10ef-4bf6-8cf0-80ae2f3367b1', '6ab1ff0a-02ae-41be-ad88-c0ce8e9d61f5', '77d05c6f-46af-445b-8b40-1aa115563f8e', 'bd117aa9-cbce-4383-bbe3-7ea488e66f20', '2995ffdf-f813-40b5-96bc-dfe7681b63c5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:33 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 Sep 23 00:36:33 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Delete snapshot completed successfully. Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3ecfd1b-524c-4d31-8189-170c9f7133cf tempest-VolumeDependencyTests-53786138 None] Lock "cinder-0df4d0ce-7455-452f-bb7b-3bf085bb39ed-delete_snapshot" released by "delete_snapshot" :: held 2.586s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 1G" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Downloaded image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb ((None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}])) to volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Temporary image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb for user 9057737caa6f4fbe835349fed45fe9f3 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Marking volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Copying metadata from image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb to 0bcca8a5-44d1-47a2-825f-c428f7a910c3. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Creating volume glance metadata for volume 0bcca8a5-44d1-47a2-825f-c428f7a910c3 backed by image b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0fa2b2f56828e08e6e74a8f5962cb124', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1cc6b5-dd67-4514-ac1e-93c0de45afbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3', 'volume_size': 1, 'image_id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0fa2b2f56828e08e6e74a8f5962cb124', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f7b407955f345059c596531e13c375c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a37c0f5ccc35cc0d89b6fe7af5cbdc2d88bea2068ff6c8ee209881180fba5867c085cf89a261f7ed12a359de59c1158e387fcd2fcf5ad2872b54bbdd8fab4e14', 'id': 'b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb', 'created_at': datetime.datetime(2026, 9, 22, 22, 36, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 36, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b73f6477-cfaa-44b7-a0cc-f7f37fed3eeb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b783196-322f-4b2e-87be-e0767df75de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.540s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730951407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:23Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume 2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Volume volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 (0bcca8a5-44d1-47a2-825f-c428f7a910c3): created successfully Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b783196-322f-4b2e-87be-e0767df75de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Flow 'volume_create_manager' (7baab83d-beaf-45fb-a731-9b3385df1789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a 1073741824 Sep 23 00:36:33 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9aa703-d378-42d6-9b95-431f8e1fb8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6dd104-cc7a-4f96-9411-e64242f0b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-623e4652-dbea-4972-8eb8-a50fb76602ac tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Created volume successfully. Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 (3bb58dfe-ae50-449c-a8ba-b82cd9be2418): created successfully Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6dd104-cc7a-4f96-9411-e64242f0b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (7b688fbf-35e3-4c59-a15e-3ae42c51ec41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f145ed36-bb9b-41ca-9d50-ce3595b6ca5a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-d0122b2b-01c3-4ed4-9412-db1d4c13fe55-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (3b38d85f-9d1b-4b0d-871b-15b29d731711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a21f2-9e6e-4e99-be4f-cbc4cf89df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "cinder-d0122b2b-01c3-4ed4-9412-db1d4c13fe55-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f3a21f2-9e6e-4e99-be4f-cbc4cf89df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537138600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e643bbf-bfc9-4a12-a784-9d9bd839e7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:34Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b17ec36-a589-4204-9d24-71025f7e1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b17ec36-a589-4204-9d24-71025f7e1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dffc24a-2df9-44b1-a5c5-3000433a5b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dffc24a-2df9-44b1-a5c5-3000433a5b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e643bbf-bfc9-4a12-a784-9d9bd839e7f2', 'volume_name': 'volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c039fb74-20bd-46c9-bd79-62cbfbc38a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c039fb74-20bd-46c9-bd79-62cbfbc38a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1dad27-cb04-4c84-ba9a-b9bb91e2def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Volume 7e643bbf-bfc9-4a12-a784-9d9bd839e7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2', 'volume_size': 1} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:34 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9623d90-5966-4a11-9768-ee679464ca23]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a 1073741824" returned: 0 in 0.562s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a Sep 23 00:36:34 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:34 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.682s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314334483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eeda75-948c-4ab7-a384-7661d3e3e229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1170dcabb4754075a889534ef606b09f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='3ed7abb1802646e2847429ccb6fbbdfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Creating volume 41eeda75-948c-4ab7-a384-7661d3e3e229 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:34 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a1b572-9620-40cc-8f0b-0aa0ff630682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fa7eed-59ce-4c85-9330-ff82c057857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:34 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 1073741824 Sep 23 00:36:34 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Acquiring lock "cinder-0bcca8a5-44d1-47a2-825f-c428f7a910c3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a (2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a): created successfully Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fa7eed-59ce-4c85-9330-ff82c057857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:34 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (88e2700a-2e82-46cf-9b0d-92ff575b2985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "cinder-0bcca8a5-44d1-47a2-825f-c428f7a910c3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1ad8e756-810d-4901-84df-d6b53c59804a tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:34 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55 Sep 23 00:36:34 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Acquiring lock "cinder-quobyte-0bcca8a5-44d1-47a2-825f-c428f7a910c3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "cinder-quobyte-0bcca8a5-44d1-47a2-825f-c428f7a910c3" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5715173-c237-4e5e-99a4-8f25639037fc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 Sep 23 00:36:34 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-d0122b2b-01c3-4ed4-9412-db1d4c13fe55" released by "delete_volume" :: held 0.845s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Created reservations ['13dc29cd-338a-4fe1-af9a-3e30835d217e', '96e03e63-f0b3-4ad0-a18f-5458fff48f51', '40a52ea9-6a6e-4f3f-8110-c28f3a1a8b68', '30dce1de-9d79-4847-aa5c-b025ae62c5e5', '53f668f4-032d-44c9-a286-4012b94cffae'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:35 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 1073741824" returned: 0 in 0.583s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:35 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 Sep 23 00:36:35 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-c7a8ee4b-9b68-4512-aaf0-170390bd0b30-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:35 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:35 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-c7a8ee4b-9b68-4512-aaf0-170390bd0b30-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:35 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3 Sep 23 00:36:35 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67a407-dae7-4196-bdf9-7117f1b5c0e1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537138600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e643bbf-bfc9-4a12-a784-9d9bd839e7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:34Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Creating volume 7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 Sep 23 00:36:35 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 1073741824 Sep 23 00:36:35 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03c5a40-d62a-4629-9146-d526b9dde7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41eeda75-948c-4ab7-a384-7661d3e3e229', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c230dd-b984-4baf-9143-7d9eccdbccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Deleted volume successfully. Sep 23 00:36:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Volume volume-41eeda75-948c-4ab7-a384-7661d3e3e229 (41eeda75-948c-4ab7-a384-7661d3e3e229): created successfully Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c230dd-b984-4baf-9143-7d9eccdbccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Flow 'volume_create_manager' (1e86658b-b733-4bd5-b987-ed991531b7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:35 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-abe93347-a957-486f-a463-91bf03e1d77b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created volume successfully. Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0bcca8a5-44d1-47a2-825f-c428f7a910c3" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eaf8f4ec-f90e-42db-ba15-ca35cd12b80f tempest-VolumeDependencyTests-53786138 None] Lock "cinder-d0122b2b-01c3-4ed4-9412-db1d4c13fe55-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "cinder-quobyte-0bcca8a5-44d1-47a2-825f-c428f7a910c3" released by "delete_volume" :: held 0.887s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Created reservations ['7a684103-f249-4d49-8a52-8860d2f691b7', 'cec83deb-2a9a-4cc0-9050-9d8e2646a9b1', '03e136bd-1ccf-4a5f-9765-db1329ed8f75', 'fc946cde-5974-4470-9903-ae29e1cabce9', '297e448e-e8cb-4de5-8d37-ef119f0dc5db'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:35 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" returned: 0 in 0.498s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30 Sep 23 00:36:35 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-41eeda75-948c-4ab7-a384-7661d3e3e229-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-41eeda75-948c-4ab7-a384-7661d3e3e229-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:36 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 1073741824" returned: 0 in 0.638s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-41eeda75-948c-4ab7-a384-7661d3e3e229" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:36 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-41eeda75-948c-4ab7-a384-7661d3e3e229" acquired by "delete_volume" :: waited 0.048s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:36 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 Sep 23 00:36:36 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Deleted volume successfully. Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c62bdc-5fea-46c9-87a2-852635bf6ae4]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f86e3ef6-f300-4b0a-9ea7-6e2572f0cd32 tempest-VolumeAndVolumeTypeFromImageTest-1673587784 None] Lock "cinder-0bcca8a5-44d1-47a2-825f-c428f7a910c3-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:36 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-quobyte-c7a8ee4b-9b68-4512-aaf0-170390bd0b30" released by "delete_volume" :: held 1.018s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:36 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 Sep 23 00:36:36 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Created reservations ['438765cd-5a75-4b20-a7cf-7affd6e192d0', '118263ce-af5d-44c7-94a3-3a0f3ed4d017', '29192f2d-ab2d-49ba-8b2c-0310fd2c4f7f', '012149a6-0b68-4493-83e3-42970db23df1', 'a6cbc68c-2c32-4bf1-a352-5f4c2ca2a4d2'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:36 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:36 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1dad27-cb04-4c84-ba9a-b9bb91e2def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdff478-fceb-4dd7-b7f9-38df50d747e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Volume volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 (7e643bbf-bfc9-4a12-a784-9d9bd839e7f2): created successfully Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdff478-fceb-4dd7-b7f9-38df50d747e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (3b38d85f-9d1b-4b0d-871b-15b29d731711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c7844a6-6bfb-43f6-bf48-4ae85a9b6920 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:36:36 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229 Sep 23 00:36:36 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Deleted volume successfully. Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33a32b50-a521-465f-a0f9-02576c469202 tempest-VolumeDependencyTests-53786138 None] Lock "cinder-c7a8ee4b-9b68-4512-aaf0-170390bd0b30-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:36 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-41eeda75-948c-4ab7-a384-7661d3e3e229" returned: 0 in 0.258s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-41eeda75-948c-4ab7-a384-7661d3e3e229" released by "delete_volume" :: held 0.743s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['1e71d1e8-cb60-45b4-b57a-addd04cdce72', '85bb49fb-1430-4513-bff7-7a40bad7e28f', '8ab25afa-6e63-499e-9ed5-b51a8eb879ff', '8aa409de-87c5-4ca1-ac27-815b6e5ffd23', '5ca25ea4-e14f-4072-91c7-d093f4912a68'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:37 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585b33e-8855-4cc4-bcbc-b2f5354f97e7]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:37 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fd4d5fb7-f251-482e-ba9c-b13f1b706397 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-41eeda75-948c-4ab7-a384-7661d3e3e229-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot 93a5a661-d651-47af-8c29-ca83c262ed28 of volume 7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:37 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a Sep 23 00:36:37 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b51f813-8d56-4904-b721-c0ca9af43c55]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:37 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 Sep 23 00:36:37 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:37 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:36:37 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a Sep 23 00:36:38 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 1G Sep 23 00:36:38 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a" released by "delete_volume" :: held 0.910s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['e3a2fcc1-fb74-45cd-b726-1599762f8239', 'e5766645-e04b-443b-851b-84c23fa30dbb', '095c204b-4d65-48fc-994a-b2dedb03b594', '3f72ecb6-2cce-4c9b-ac74-d99030d5c69b', 'fc2d0b3f-7102-475a-94fe-469ba52c9a15'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:38 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 1G" returned: 0 in 0.595s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:38 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 Sep 23 00:36:38 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:38 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45f238ac-92c4-4314-b966-ce5a4150c4e7 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-2cdc0cf6-5a8a-4648-9d9e-21f65e48e43a-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:39 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 is being set with open permissions: ugo+rw Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 Sep 23 00:36:39 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-3bb58dfe-ae50-449c-a8ba-b82cd9be2418-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-3bb58dfe-ae50-449c-a8ba-b82cd9be2418-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:39 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info Sep 23 00:36:39 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ab820-a281-4c13-b2ac-ad3be171c4e6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 Sep 23 00:36:39 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:39 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info is being set with open permissions: ugo+rw Sep 23 00:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info Sep 23 00:36:39 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.info" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418 Sep 23 00:36:40 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-14999f55-663c-4bde-bc79-2f21e4f94045 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:36:40 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-3bb58dfe-ae50-449c-a8ba-b82cd9be2418" released by "delete_volume" :: held 0.885s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['6a78d718-b51e-452b-9f0c-716d62e877f1', '182b141c-3d5c-43ff-83c6-848a78daebae', '87f549e9-9a20-4fc8-b038-dae775a0776b', '6884f606-c36c-485e-95f7-ad7a233f8f25', 'f70d0a7c-a75a-4d47-afab-145ea059b33d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-93a5a661-d651-47af-8c29-ca83c262ed28-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:40 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-93a5a661-d651-47af-8c29-ca83c262ed28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-93a5a661-d651-47af-8c29-ca83c262ed28" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-93a5a661-d651-47af-8c29-ca83c262ed28" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot 93a5a661-d651-47af-8c29-ca83c262ed28 of volume 7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa8ed3b-5be5-4c70-ad0c-a1345d4dea37]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 Sep 23 00:36:41 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b088f679-b03e-4f5f-ab9f-766a41cde115 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-3bb58dfe-ae50-449c-a8ba-b82cd9be2418-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:41 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb75c12-a868-4ef3-a03d-eb310445770c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 Sep 23 00:36:41 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-c4c63cab-3ad2-4a33-84ec-1c88ded4987e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:41 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-c4c63cab-3ad2-4a33-84ec-1c88ded4987e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:41 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 Sep 23 00:36:41 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8e5319-b2fd-48a5-af22-00c610d659a0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e Sep 23 00:36:42 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28 Sep 23 00:36:42 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" returned: 0 in 0.482s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e Sep 23 00:36:42 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2.93a5a661-d651-47af-8c29-ca83c262ed28" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-93a5a661-d651-47af-8c29-ca83c262ed28" released by "_delete_snapshot" :: held 1.870s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" released by "delete_snapshot" :: held 1.910s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Created reservations ['88f7cc3d-b69c-4519-9a2c-9549adddf061', '25d135e4-6af3-4704-9040-5ccc1d0bdfc7', 'f42f0d73-db92-4d50-a518-1603c7612d32', 'b94e7e99-d002-49b8-956d-26e04581258a', '56d00dd8-7a24-47d3-8da0-71a6d6d64745'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:42 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-c4c63cab-3ad2-4a33-84ec-1c88ded4987e" released by "delete_volume" :: held 0.882s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (5292edae-5513-4480-8f9d-53e5f4d98d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e170a419-7b48-4f86-8f96-96851e085c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e170a419-7b48-4f86-8f96-96851e085c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569095370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f870c7-266b-4226-a105-23afedc48aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e318d6-25eb-4fe3-82b9-b9e004b47b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e318d6-25eb-4fe3-82b9-b9e004b47b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fd7e23-6d8e-4454-8782-e9d00ed8dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6fd7e23-6d8e-4454-8782-e9d00ed8dd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f870c7-266b-4226-a105-23afedc48aee', 'volume_name': 'volume-e6f870c7-266b-4226-a105-23afedc48aee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafeef2-ea1b-4240-ba94-7dacec8550fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafeef2-ea1b-4240-ba94-7dacec8550fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1e103d-84a7-43ef-8ea5-4d779689e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Volume e6f870c7-266b-4226-a105-23afedc48aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f870c7-266b-4226-a105-23afedc48aee', 'volume_size': 1} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-569095370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f870c7-266b-4226-a105-23afedc48aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Creating volume e6f870c7-266b-4226-a105-23afedc48aee {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee 1073741824 Sep 23 00:36:43 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0027a8d-d8cc-4316-b3d7-a851763e8c48 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-93a5a661-d651-47af-8c29-ca83c262ed28-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['998f3c69-c388-4903-a2c4-c3efaa80feb6', '06c3af90-f4c8-459e-bc73-7ed19603da9f', 'a09f68da-b6db-4b2c-b459-3fc128736386', '7edfd440-b861-4741-9e61-13cbe6d105ee', '27842463-431e-44d4-a9d0-bba1f1348f05'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:43 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (d903e207-f572-483b-addc-7804452decd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3d3f62-4ab7-4174-aee1-e6b3841e02fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3d3f62-4ab7-4174-aee1-e6b3841e02fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192562388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e264b1-cb09-4482-bd9f-76e892846e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058a06ab-56d0-44c7-98d4-7c8138615a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058a06ab-56d0-44c7-98d4-7c8138615a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b0e754-2227-436c-8dec-ccb291768d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b0e754-2227-436c-8dec-ccb291768d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e264b1-cb09-4482-bd9f-76e892846e12', 'volume_name': 'volume-c1e264b1-cb09-4482-bd9f-76e892846e12', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dbfca1-6aa0-4330-bae4-8f5bd9992b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dbfca1-6aa0-4330-bae4-8f5bd9992b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc0871-1a24-4c9a-a617-08fe19164b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Volume c1e264b1-cb09-4482-bd9f-76e892846e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e264b1-cb09-4482-bd9f-76e892846e12', 'volume_size': 1} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:43 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0501615e-5afa-4678-a5ce-7a478694435b tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-c4c63cab-3ad2-4a33-84ec-1c88ded4987e-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:43 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee 1073741824" returned: 0 in 0.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee Sep 23 00:36:43 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (b7b65f98-17fd-4108-84d7-539344337918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d4ad6-c381-46d8-b5c6-f8778505c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d4ad6-c381-46d8-b5c6-f8778505c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791366636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f869b6d-b0c8-4341-b39b-89083166f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:44Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fd2637-30fd-4e71-b277-62e61185a7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fd2637-30fd-4e71-b277-62e61185a7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e747f4-8306-439a-abec-d736193348f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e747f4-8306-439a-abec-d736193348f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f869b6d-b0c8-4341-b39b-89083166f616', 'volume_name': 'volume-1f869b6d-b0c8-4341-b39b-89083166f616', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03e7d56-08e4-413f-b2ad-069cd7713f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03e7d56-08e4-413f-b2ad-069cd7713f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538bda5a-2a27-411d-bf96-85fed6aee841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Volume 1f869b6d-b0c8-4341-b39b-89083166f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f869b6d-b0c8-4341-b39b-89083166f616', 'volume_size': 1} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:44 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee" returned: 0 in 0.316s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192562388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e264b1-cb09-4482-bd9f-76e892846e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:43Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Creating volume c1e264b1-cb09-4482-bd9f-76e892846e12 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:44 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1e103d-84a7-43ef-8ea5-4d779689e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f870c7-266b-4226-a105-23afedc48aee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e15ce6c-5d25-40e1-8901-e763817a376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 1073741824 Sep 23 00:36:44 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Volume volume-e6f870c7-266b-4226-a105-23afedc48aee (e6f870c7-266b-4226-a105-23afedc48aee): created successfully Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e15ce6c-5d25-40e1-8901-e763817a376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (5292edae-5513-4480-8f9d-53e5f4d98d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-35c5084d-f6ec-45e5-b622-e0b06dfd8959 tempest-CreateVolumesFromImageTest-200871075 None] Created volume successfully. Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (6899b333-8faa-485d-99e4-79825f5aefd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fc731a-07ab-485a-8174-f3965ce6217a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-f0f460ad-ae72-4246-b312-642755047e81-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fc731a-07ab-485a-8174-f3965ce6217a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041253458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1da013-4495-4a2f-819e-8b2649a013e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:44Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429d426b-1eac-4d30-9027-9eb5eceef973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429d426b-1eac-4d30-9027-9eb5eceef973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6adab-27b4-4ae3-accd-537164ff30fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c6adab-27b4-4ae3-accd-537164ff30fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1da013-4495-4a2f-819e-8b2649a013e3', 'volume_name': 'volume-be1da013-4495-4a2f-819e-8b2649a013e3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3136fdc8-893d-448f-9611-b86b0aada5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3136fdc8-893d-448f-9611-b86b0aada5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d8d9ee-c0f4-458a-817d-cae69c133882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Volume be1da013-4495-4a2f-819e-8b2649a013e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1da013-4495-4a2f-819e-8b2649a013e3', 'volume_size': 1} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-f0f460ad-ae72-4246-b312-642755047e81-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 1073741824" returned: 0 in 0.607s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-f0f460ad-ae72-4246-b312-642755047e81" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23c51e-cdd7-4836-9e7a-1bed4a1967a8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-f0f460ad-ae72-4246-b312-642755047e81" acquired by "delete_volume" :: waited 0.052s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc04ec-ec1f-454e-989e-15d4d33bd1d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:44 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 Sep 23 00:36:44 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 Sep 23 00:36:44 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 Sep 23 00:36:44 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (f30fbcec-d4c6-4720-b7a6-d7319526ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a97e93-55fb-4ba1-bae7-cd480e0e9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a97e93-55fb-4ba1-bae7-cd480e0e9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410594605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74590376-927e-4e73-805f-e158ea734140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:45Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a3f1c5-1289-4d7d-b245-0f18c6c029a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a3f1c5-1289-4d7d-b245-0f18c6c029a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d3cb67-6e9d-49fb-9b87-2ae15c5c5e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d3cb67-6e9d-49fb-9b87-2ae15c5c5e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74590376-927e-4e73-805f-e158ea734140', 'volume_name': 'volume-74590376-927e-4e73-805f-e158ea734140', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de445c63-17d5-4227-9954-9dbc3065e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de445c63-17d5-4227-9954-9dbc3065e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37d33c-0bf9-4a9f-ae45-6026aadfe042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Volume 74590376-927e-4e73-805f-e158ea734140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74590376-927e-4e73-805f-e158ea734140', 'volume_size': 1} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791366636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f869b6d-b0c8-4341-b39b-89083166f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:44Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Creating volume 1f869b6d-b0c8-4341-b39b-89083166f616 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc0871-1a24-4c9a-a617-08fe19164b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e264b1-cb09-4482-bd9f-76e892846e12', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 1073741824 Sep 23 00:36:45 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c172d61b-d9f4-4507-8b87-2aff9abdff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Volume volume-c1e264b1-cb09-4482-bd9f-76e892846e12 (c1e264b1-cb09-4482-bd9f-76e892846e12): created successfully Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c172d61b-d9f4-4507-8b87-2aff9abdff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (d903e207-f572-483b-addc-7804452decd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:45 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3e5724a0-e10b-448b-9e01-5ff0966d9ac5 tempest-CreateVolumesFromImageTest-200871075 None] Created volume successfully. Sep 23 00:36:45 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2 Sep 23 00:36:45 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81" returned: 0 in 0.622s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81 Sep 23 00:36:45 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2" released by "delete_volume" :: held 0.954s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Created reservations ['bda97839-0764-4b05-98f4-9639cae6be6a', '7431768f-8c3f-46a8-8fef-b9c3c12cb7a6', '1f912c1a-9375-4baa-adfb-5018b8af297a', '6908a102-e05e-454b-bd21-d7f6a786dd21', 'cc214d50-38b1-4b4c-a4a4-e57652ec189c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:45 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 1073741824" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-f0f460ad-ae72-4246-b312-642755047e81" returned: 0 in 0.365s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:45 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-f0f460ad-ae72-4246-b312-642755047e81" released by "delete_volume" :: held 1.056s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['5d3b38aa-414e-4ad8-bd8f-5d5526b4a268', '2588c324-3170-43ba-9847-32f7edb4d680', 'c970fff3-5279-4f4d-b0c6-e5153c388700', '2dd4607f-4352-4331-9a64-2686d3a8ffd6', 'f34b8d67-1fcb-43c1-8013-369c30883c37'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:45 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:45 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:45 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2041253458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1da013-4495-4a2f-819e-8b2649a013e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:44Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Creating volume be1da013-4495-4a2f-819e-8b2649a013e3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:46 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:46 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 1073741824 Sep 23 00:36:46 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538bda5a-2a27-411d-bf96-85fed6aee841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f869b6d-b0c8-4341-b39b-89083166f616', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0317389d-c134-4ed0-bd5a-100f315e0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Volume volume-1f869b6d-b0c8-4341-b39b-89083166f616 (1f869b6d-b0c8-4341-b39b-89083166f616): created successfully Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0317389d-c134-4ed0-bd5a-100f315e0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (b7b65f98-17fd-4108-84d7-539344337918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e1b90022-6ff9-4741-9a7b-d19313e25102 tempest-CreateVolumesFromImageTest-200871075 None] Created volume successfully. Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8b4d7328-2df1-4286-8d81-518db19af1e0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-7e643bbf-bfc9-4a12-a784-9d9bd839e7f2-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:46 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-aa77afea-8981-4fbc-a827-523ccc93f733 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-f0f460ad-ae72-4246-b312-642755047e81-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:46 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 1073741824" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 Sep 23 00:36:46 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410594605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74590376-927e-4e73-805f-e158ea734140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c676720624994525a66bb81640c1c263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:45Z,use_quota=True,user_id='9a22a819d0a347edaf1119b52d67fa7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Creating volume 74590376-927e-4e73-805f-e158ea734140 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-e21bead2-0ff3-4235-8a19-a3755a914a74-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:46 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 1073741824 Sep 23 00:36:46 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d8d9ee-c0f4-458a-817d-cae69c133882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1da013-4495-4a2f-819e-8b2649a013e3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17912c7f-3cf2-44fb-82c0-0d31a3b50f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Volume volume-be1da013-4495-4a2f-819e-8b2649a013e3 (be1da013-4495-4a2f-819e-8b2649a013e3): created successfully Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17912c7f-3cf2-44fb-82c0-0d31a3b50f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (6899b333-8faa-485d-99e4-79825f5aefd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-e21bead2-0ff3-4235-8a19-a3755a914a74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-631e6f2e-ee63-41a5-9120-95b83b318b62 tempest-CreateVolumesFromImageTest-200871075 None] Created volume successfully. Sep 23 00:36:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-e21bead2-0ff3-4235-8a19-a3755a914a74" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e21bead2-0ff3-4235-8a19-a3755a914a74" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleting offline snapshot e21bead2-0ff3-4235-8a19-a3755a914a74 of volume e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] snapshot_file for this snap is: volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[32437d24-3898-4eab-993b-d912e196d09d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 Sep 23 00:36:47 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (ab75e843-92c1-40db-a2c5-fdd83abb6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd92c62-f7e3-4796-8453-375458a8acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd92c62-f7e3-4796-8453-375458a8acdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233918780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0a545-3359-4b06-9973-d3a567e45a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:47Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d7be01-6144-49ae-997c-098b46ad5a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d7be01-6144-49ae-997c-098b46ad5a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2571ce-b10e-48b7-bec5-d0ebccccb5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2571ce-b10e-48b7-bec5-d0ebccccb5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e0a545-3359-4b06-9973-d3a567e45a56', 'volume_name': 'volume-87e0a545-3359-4b06-9973-d3a567e45a56', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0585f4-913f-4d66-8035-5f5ea9436c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0585f4-913f-4d66-8035-5f5ea9436c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b95af3-25e2-44a6-9c34-819abec239d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Volume 87e0a545-3359-4b06-9973-d3a567e45a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e0a545-3359-4b06-9973-d3a567e45a56', 'volume_size': 1} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 1073741824" returned: 0 in 0.785s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 Sep 23 00:36:47 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e846586d-7b01-43f3-ae1f-362a95d9481b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76abc7-ed02-4d07-bef8-7035df52f8d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b Sep 23 00:36:47 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233918780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0a545-3359-4b06-9973-d3a567e45a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:47Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Creating volume 87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:47 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 1073741824 Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37d33c-0bf9-4a9f-ae45-6026aadfe042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74590376-927e-4e73-805f-e158ea734140', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f101ba-617d-4ac4-9d33-9487096215d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Volume volume-74590376-927e-4e73-805f-e158ea734140 (74590376-927e-4e73-805f-e158ea734140): created successfully Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f101ba-617d-4ac4-9d33-9487096215d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Flow 'volume_create_manager' (f30fbcec-d4c6-4720-b7a6-d7319526ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b686f9d4-518b-4e8a-a6e8-d789a75c6d12 tempest-CreateVolumesFromImageTest-200871075 None] Created volume successfully. Sep 23 00:36:48 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 Sep 23 00:36:48 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 1073741824" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 Sep 23 00:36:48 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-74590376-927e-4e73-805f-e158ea734140-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74 Sep 23 00:36:48 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-74590376-927e-4e73-805f-e158ea734140-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-quobyte-74590376-927e-4e73-805f-e158ea734140" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-74590376-927e-4e73-805f-e158ea734140" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28fc80-4a87-4716-8e8b-5f42b28e1526]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:48 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 Sep 23 00:36:48 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b95af3-25e2-44a6-9c34-819abec239d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e0a545-3359-4b06-9973-d3a567e45a56', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:48 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9642f2-20d5-4f20-9c8d-b00bba628dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b.e21bead2-0ff3-4235-8a19-a3755a914a74" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Volume volume-87e0a545-3359-4b06-9973-d3a567e45a56 (87e0a545-3359-4b06-9973-d3a567e45a56): created successfully Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9642f2-20d5-4f20-9c8d-b00bba628dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (ab75e843-92c1-40db-a2c5-fdd83abb6de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e21bead2-0ff3-4235-8a19-a3755a914a74" released by "_delete_snapshot" :: held 1.996s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" released by "delete_snapshot" :: held 2.046s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1fa13908-a867-4239-b1b2-dd655f5540ee tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['0eab40a9-1c7b-461f-8289-934ecd072a77', 'c7460195-154e-4fb3-b947-0e3da41a58d7', 'c75b7338-6cd7-4921-b75a-46c39198d4d1', 'fde99884-5a3f-4843-a1fc-51da065dcc12', 'a32511ad-d791-4806-ad56-41c09a8eb304'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Delete snapshot completed successfully. Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8912c6cf-adfd-4979-adb3-a01e62d9e8db tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-e21bead2-0ff3-4235-8a19-a3755a914a74-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:49 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140 Sep 23 00:36:49 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:49 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-74590376-927e-4e73-805f-e158ea734140" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-74590376-927e-4e73-805f-e158ea734140" released by "delete_volume" :: held 0.774s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Created reservations ['b1b70d84-ce04-446a-a5b0-b260c169a017', '93f1de05-f756-4512-93d0-248858f0e208', '9243a826-d05c-4819-8556-5a123d15a947', 'b3767d29-0ce3-422b-9d44-2e834836876d', '7a734be9-39e7-47a7-8ab8-352fc78de00e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:36:49 devstack cinder-volume[86731]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:36:49 devstack cinder-volume[86731]: FROM reservations Sep 23 00:36:49 devstack cinder-volume[86731]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:36:49 devstack cinder-volume[86731]: [parameters: {'uuid_1_1': 'b1b70d84-ce04-446a-a5b0-b260c169a017', 'uuid_1_2': '93f1de05-f756-4512-93d0-248858f0e208', 'uuid_1_3': '9243a826-d05c-4819-8556-5a123d15a947', 'uuid_1_4': 'b3767d29-0ce3-422b-9d44-2e834836876d', 'uuid_1_5': '7a734be9-39e7-47a7-8ab8-352fc78de00e'}] Sep 23 00:36:49 devstack cinder-volume[86731]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86731) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86731) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-be1da013-4495-4a2f-819e-8b2649a013e3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot 409bede2-5159-406d-966c-7c2620c727a5 of volume 87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-be1da013-4495-4a2f-819e-8b2649a013e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48987e04-36d5-4473-9cc7-9b0ae9ae003d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-quobyte-be1da013-4495-4a2f-819e-8b2649a013e3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-be1da013-4495-4a2f-819e-8b2649a013e3" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-e846586d-7b01-43f3-ae1f-362a95d9481b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19047ec-5afc-41c8-96c0-5b763daa1f38]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 Sep 23 00:36:50 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-e846586d-7b01-43f3-ae1f-362a95d9481b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f451a2-d365-4d9c-8a7b-a5692bab1622]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 Sep 23 00:36:50 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b Sep 23 00:36:50 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56" returned: 0 in 0.507s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 1G Sep 23 00:36:50 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3 Sep 23 00:36:50 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b" returned: 0 in 0.536s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:50 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:50 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:50 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b Sep 23 00:36:50 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-be1da013-4495-4a2f-819e-8b2649a013e3" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-be1da013-4495-4a2f-819e-8b2649a013e3" released by "delete_volume" :: held 0.987s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 1G" returned: 0 in 0.625s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e0a545-3359-4b06-9973-d3a567e45a56 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e0a545-3359-4b06-9973-d3a567e45a56 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 Sep 23 00:36:51 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Created reservations ['e8d232df-d469-4590-af4b-d60fbd260857', 'b3001241-4a44-48b2-9b04-398a02f07fe8', 'e859ae90-8bd3-491c-9e43-0a38a77ca4c8', '908ec38c-38d7-45d2-9307-351692cc246b', '1ae632bd-2417-48d6-99f2-3a29eaae218d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:51 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e846586d-7b01-43f3-ae1f-362a95d9481b" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.461s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-quobyte-e846586d-7b01-43f3-ae1f-362a95d9481b" released by "delete_volume" :: held 1.037s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Deleted volume successfully. Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-411970a7-c673-4958-aa86-f85f5249a11d tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-74590376-927e-4e73-805f-e158ea734140-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:51 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Created reservations ['e84881b0-8946-4b12-9bb3-8f5680743e5d', 'c504e50c-8419-4d6c-95f8-466c09578189', '8b3290e3-976b-4322-ba91-55747ce67eca', '57ed1470-63c7-4bbe-9374-ccf445672411', '681cf7ce-60fe-4677-8a7b-13062c0aa50b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:51 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87e0a545-3359-4b06-9973-d3a567e45a56 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 is being set with open permissions: ugo+rw Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:51 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:51 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:51 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Deleted volume successfully. Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1675e489-32fd-49b0-92f5-a5fdeeebe67f tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-be1da013-4495-4a2f-819e-8b2649a013e3-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:51 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Deleted volume successfully. Sep 23 00:36:51 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info Sep 23 00:36:51 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec678b4f-26c2-4cf5-b218-da4fcb28ffc6 tempest-CreateVolumesFromSnapshotTest-1569253714 None] Lock "cinder-e846586d-7b01-43f3-ae1f-362a95d9481b-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:52 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info is being set with open permissions: ugo+rw Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info Sep 23 00:36:52 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-1f869b6d-b0c8-4341-b39b-89083166f616-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-1f869b6d-b0c8-4341-b39b-89083166f616-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-quobyte-1f869b6d-b0c8-4341-b39b-89083166f616" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-1f869b6d-b0c8-4341-b39b-89083166f616" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac068804-379b-42cf-bb65-4ec9d86b2261]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.info" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 Sep 23 00:36:52 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-39357c0a-2f7c-4b11-9534-d47525f090e2 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:36:52 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616 Sep 23 00:36:52 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-409bede2-5159-406d-966c-7c2620c727a5-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-409bede2-5159-406d-966c-7c2620c727a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-409bede2-5159-406d-966c-7c2620c727a5" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-1f869b6d-b0c8-4341-b39b-89083166f616" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-1f869b6d-b0c8-4341-b39b-89083166f616" released by "delete_volume" :: held 0.825s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-409bede2-5159-406d-966c-7c2620c727a5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot 409bede2-5159-406d-966c-7c2620c727a5 of volume 87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e623be-7966-4bfc-99e3-d26231f32094]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Created reservations ['5af58b74-b72c-418e-910f-6e00143e6ef5', '6fdc3d55-5c0e-4565-8c83-98cd89914087', 'de8e88fb-c8de-4861-920c-08a0c639fcc3', 'b7599137-ed60-412a-8340-bdcc24ee236a', '0d744fe0-7285-45bc-9c14-0540890bdc02'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:53 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:53 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:53 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-c1e264b1-cb09-4482-bd9f-76e892846e12-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-c1e264b1-cb09-4482-bd9f-76e892846e12-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-quobyte-c1e264b1-cb09-4482-bd9f-76e892846e12" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-c1e264b1-cb09-4482-bd9f-76e892846e12" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5095d2-4c57-499e-abb4-d9c3d0f46f22]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5" returned: 0 in 0.622s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87e0a545-3359-4b06-9973-d3a567e45a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Deleted volume successfully. Sep 23 00:36:53 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 Sep 23 00:36:53 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae4185e-b411-4e02-9da5-75194f9fa0a0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07c11fd8-6c4a-449e-82ce-dcfc8337bd1b tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-1f869b6d-b0c8-4341-b39b-89083166f616-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:54 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 Sep 23 00:36:54 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12 Sep 23 00:36:54 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 Sep 23 00:36:54 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c1e264b1-cb09-4482-bd9f-76e892846e12" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-c1e264b1-cb09-4482-bd9f-76e892846e12" released by "delete_volume" :: held 0.969s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Created reservations ['6d30b8ed-79c8-4b8a-a844-16bb40f48a3d', 'e7fd6e65-18c5-448a-96c5-8618bad11272', 'a61de0a6-4435-4a85-b535-70a15d5363fd', 'ca19e9a4-6b7c-43da-9dde-889a12926dc9', 'bcd0f1b8-bca9-4f69-9251-f58c402952ac'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:54 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5 Sep 23 00:36:54 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Deleted volume successfully. Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9f3e1e80-5498-4a9c-92a2-5c33683d4fe7 tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-c1e264b1-cb09-4482-bd9f-76e892846e12-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56.409bede2-5159-406d-966c-7c2620c727a5" returned: 0 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-409bede2-5159-406d-966c-7c2620c727a5" released by "_delete_snapshot" :: held 2.145s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" released by "delete_snapshot" :: held 2.188s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Created reservations ['edf6ccd0-b4c3-4c1b-90b7-5a6e6a67dce2', '7c12fa78-dd92-4d2b-8dec-4e4ed32a0b32', '8b0f855b-ab1e-4abf-a09d-6c7f23780afb', '560d484a-5d85-4463-820e-d7a4c60148e9', '2b780a42-df83-4918-959c-82205aeae411'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-552241e3-c1f5-4f27-9401-d0e3fe01d295 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-409bede2-5159-406d-966c-7c2620c727a5-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-e6f870c7-266b-4226-a105-23afedc48aee-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-e6f870c7-266b-4226-a105-23afedc48aee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "cinder-quobyte-e6f870c7-266b-4226-a105-23afedc48aee" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-e6f870c7-266b-4226-a105-23afedc48aee" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[79985428-7360-4be8-a2f4-5a500ae94223]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee Sep 23 00:36:56 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-87e0a545-3359-4b06-9973-d3a567e45a56-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee Sep 23 00:36:56 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-87e0a545-3359-4b06-9973-d3a567e45a56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3bac7-e56d-4830-b6ab-777fe34300d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (9514ff8c-3883-4ee2-b472-7638bd3931ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d897aa-5110-4c8c-84d3-5a67114f145e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d897aa-5110-4c8c-84d3-5a67114f145e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458749808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25259df0-73cb-439e-ae90-b2777148e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:56Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703c0588-518d-43b4-8793-7485df82001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703c0588-518d-43b4-8793-7485df82001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5492323-6264-4563-914d-dcefb3626a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5492323-6264-4563-914d-dcefb3626a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25259df0-73cb-439e-ae90-b2777148e95d', 'volume_name': 'volume-25259df0-73cb-439e-ae90-b2777148e95d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b788b22-d3b5-4846-9b23-e96ce3b05300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b788b22-d3b5-4846-9b23-e96ce3b05300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cd4da1-0f09-469c-9c8a-576a98eab811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume 25259df0-73cb-439e-ae90-b2777148e95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25259df0-73cb-439e-ae90-b2777148e95d', 'volume_size': 1} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458749808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25259df0-73cb-439e-ae90-b2777148e95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:56Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume 25259df0-73cb-439e-ae90-b2777148e95d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:56 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 Sep 23 00:36:56 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d 1073741824 Sep 23 00:36:56 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e6f870c7-266b-4226-a105-23afedc48aee" returned: 0 in 0.303s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-quobyte-e6f870c7-266b-4226-a105-23afedc48aee" released by "delete_volume" :: held 0.780s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Created reservations ['0654ae67-c0f9-47c8-afc8-e5ed7faf1f4b', 'd44010c6-3d15-4162-bda6-bd5bbda09149', '297c8e49-d764-4f70-9e54-4d16199f2de6', '665bc789-d2b4-4c75-be98-1d6140568742', '9512da2a-c770-4b23-9692-38dcb812cca7'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:56 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56 Sep 23 00:36:56 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Deleted volume successfully. Sep 23 00:36:57 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d 1073741824" returned: 0 in 0.550s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f8afab2-f4f7-434b-b544-1155955d16cc tempest-CreateVolumesFromImageTest-200871075 None] Lock "cinder-e6f870c7-266b-4226-a105-23afedc48aee-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d Sep 23 00:36:57 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-87e0a545-3359-4b06-9973-d3a567e45a56" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-87e0a545-3359-4b06-9973-d3a567e45a56" released by "delete_volume" :: held 0.857s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Created reservations ['d6b75f56-7d89-4847-8186-3a82700d273c', 'b5e87cc2-7ed6-4ab5-affa-b97928d5d937', '85321a29-6733-401e-9a3d-189d3b3a895d', '77636bbf-f578-4984-8034-667a947e877e', '7c3f7e99-1ac7-40c6-9908-62f3d42cbfbc'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:57 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:36:57 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cd4da1-0f09-469c-9c8a-576a98eab811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25259df0-73cb-439e-ae90-b2777148e95d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e9ce31-0fd7-45db-9d7f-d8936a203932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-25259df0-73cb-439e-ae90-b2777148e95d (25259df0-73cb-439e-ae90-b2777148e95d): created successfully Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e9ce31-0fd7-45db-9d7f-d8936a203932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (9514ff8c-3883-4ee2-b472-7638bd3931ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-97d1f56c-7888-42d2-a38d-1e91a0a38847 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:36:57 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:36:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4e3596e9-1dd8-401e-bbf5-9cae738064f3 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-87e0a545-3359-4b06-9973-d3a567e45a56-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (196c0c2a-7fb2-472e-8e99-3de686802216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0105639-5c4c-49cb-a70d-510f8898b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0105639-5c4c-49cb-a70d-510f8898b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028615877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2999bf-35eb-48d7-a89a-67cc4817e132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:58Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb63237-e473-4e29-9889-45fa2c8a1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb63237-e473-4e29-9889-45fa2c8a1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4001ed9-dba2-4ede-872f-bfd26109777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4001ed9-dba2-4ede-872f-bfd26109777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2999bf-35eb-48d7-a89a-67cc4817e132', 'volume_name': 'volume-3d2999bf-35eb-48d7-a89a-67cc4817e132', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f4332e-0a38-46ff-9495-20a44145b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f4332e-0a38-46ff-9495-20a44145b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d0038-65a7-49dc-a90b-55dcbc62ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Volume 3d2999bf-35eb-48d7-a89a-67cc4817e132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2999bf-35eb-48d7-a89a-67cc4817e132', 'volume_size': 1} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028615877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2999bf-35eb-48d7-a89a-67cc4817e132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:58Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Creating volume 3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 1073741824 Sep 23 00:36:58 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:58 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 1073741824" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 Sep 23 00:36:58 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:59 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (ae752a6a-e65d-4cd3-99df-8ac89e33906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19c248-0ebe-4f3f-9f95-0c74e98a9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d0038-65a7-49dc-a90b-55dcbc62ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2999bf-35eb-48d7-a89a-67cc4817e132', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6eb0e3-103f-4475-bbeb-8d347c4dc65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19c248-0ebe-4f3f-9f95-0c74e98a9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89198587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:59Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e163f2-8dcc-4919-a79d-2871fc8cf1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e163f2-8dcc-4919-a79d-2871fc8cf1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78937eab-6f48-41b6-94ca-442b5f02c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78937eab-6f48-41b6-94ca-442b5f02c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde', 'volume_name': 'volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867a37df-38b2-4a76-8cd5-f22cb4bdb260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867a37df-38b2-4a76-8cd5-f22cb4bdb260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1471ed-f1d5-4b24-a915-b94e566f63a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde', 'volume_size': 1} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89198587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:59Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Volume volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 (3d2999bf-35eb-48d7-a89a-67cc4817e132): created successfully Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6eb0e3-103f-4475-bbeb-8d347c4dc65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (196c0c2a-7fb2-472e-8e99-3de686802216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:59 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde 1073741824 Sep 23 00:36:59 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-68403a18-06e8-49ae-aadf-1514be6e54e4 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (4187c066-6a8b-4b25-8da9-b092569fba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44be2fe-be44-46e1-a548-de6bc411821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44be2fe-be44-46e1-a548-de6bc411821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082011657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b903a8e3-f5a9-4b03-b520-4573c371610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:00Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f7da6-a2d7-4a44-9004-51bb8dfc1f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094f7da6-a2d7-4a44-9004-51bb8dfc1f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cbb43a-1df8-4cd1-b1c1-96d92d71ed87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cbb43a-1df8-4cd1-b1c1-96d92d71ed87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b903a8e3-f5a9-4b03-b520-4573c371610d', 'volume_name': 'volume-b903a8e3-f5a9-4b03-b520-4573c371610d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1ec53b-2b82-4981-a298-b26e5e3cfcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1ec53b-2b82-4981-a298-b26e5e3cfcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d1f6da-6174-464b-bed6-3743246ab8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume b903a8e3-f5a9-4b03-b520-4573c371610d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b903a8e3-f5a9-4b03-b520-4573c371610d', 'volume_size': 1} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:59 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde 1073741824" returned: 0 in 0.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=189,cinder:UPDATE=242,cinder:DELETE=19,cinder:INSERT=73 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:59 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=252,cinder:SELECT=205,cinder:INSERT=74,cinder:DELETE=21 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde Sep 23 00:37:00 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (74a2e3df-1b54-4738-b0bf-2e3b5ed8250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68040d33-2af8-4357-a176-c857a62df97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68040d33-2af8-4357-a176-c857a62df97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833497203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf7f1e3-e48b-4ed5-b32e-2e483d95612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:00Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398d8bff-65a6-4234-b3a0-c187eed856ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398d8bff-65a6-4234-b3a0-c187eed856ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708a21ff-f923-404d-a0f6-790d7da51cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708a21ff-f923-404d-a0f6-790d7da51cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf7f1e3-e48b-4ed5-b32e-2e483d95612c', 'volume_name': 'volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1d00f2-151a-4902-9b6b-d3edae60e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1d00f2-151a-4902-9b6b-d3edae60e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632691e6-1f87-4f84-af89-90b33dd9548b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume caf7f1e3-e48b-4ed5-b32e-2e483d95612c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c', 'volume_size': 1} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:00 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" returned: 0 in 0.523s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082011657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b903a8e3-f5a9-4b03-b520-4573c371610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:00Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume b903a8e3-f5a9-4b03-b520-4573c371610d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:00 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1471ed-f1d5-4b24-a915-b94e566f63a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4da079-5576-4d71-abfb-5ab9380f2bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:00 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d 1073741824 Sep 23 00:37:00 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde (c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde): created successfully Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4da079-5576-4d71-abfb-5ab9380f2bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (ae752a6a-e65d-4cd3-99df-8ac89e33906a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a53feb96-09d6-474b-a760-507d109fd565 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (f8fcd077-604c-42e9-9a46-8526dc234782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e4545-175a-428e-9ff0-baf74428d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e4545-175a-428e-9ff0-baf74428d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474451812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8d9f61-a328-40ec-b730-5ec12d871eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cd5d8c-d68b-4221-886a-bc3406e50e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cd5d8c-d68b-4221-886a-bc3406e50e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa6a6c0-5d9e-481c-a399-88b9891ede2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa6a6c0-5d9e-481c-a399-88b9891ede2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8d9f61-a328-40ec-b730-5ec12d871eb9', 'volume_name': 'volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f095a4-8e24-4e60-b178-6c4dbd4e9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f095a4-8e24-4e60-b178-6c4dbd4e9e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b46585f-0e9e-4891-9963-0be99630678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume fa8d9f61-a328-40ec-b730-5ec12d871eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9', 'volume_size': 1} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d 1073741824" returned: 0 in 0.750s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:01 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d Sep 23 00:37:01 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (209297d7-317b-42ca-b70e-875e3bb3ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b753fa2-cd44-4e89-821d-c47b1350c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b753fa2-cd44-4e89-821d-c47b1350c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278666108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037b0e4d-143e-491b-a13f-12053d90e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afddef9-f0d3-4f64-8f23-821b13905165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afddef9-f0d3-4f64-8f23-821b13905165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c59936-ebdc-4fd7-a747-91216abd181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c59936-ebdc-4fd7-a747-91216abd181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037b0e4d-143e-491b-a13f-12053d90e293', 'volume_name': 'volume-037b0e4d-143e-491b-a13f-12053d90e293', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8260bbf9-1f37-4040-8237-3e834f8f801d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8260bbf9-1f37-4040-8237-3e834f8f801d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3ed20-6393-4732-8822-b93046b2297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume 037b0e4d-143e-491b-a13f-12053d90e293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037b0e4d-143e-491b-a13f-12053d90e293', 'volume_size': 1} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.238s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833497203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf7f1e3-e48b-4ed5-b32e-2e483d95612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:00Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume caf7f1e3-e48b-4ed5-b32e-2e483d95612c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:01 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:01 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c 1073741824 Sep 23 00:37:01 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d1f6da-6174-464b-bed6-3743246ab8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b903a8e3-f5a9-4b03-b520-4573c371610d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77af3a8d-c87d-46ea-a5d2-55b3f9e070a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-b903a8e3-f5a9-4b03-b520-4573c371610d (b903a8e3-f5a9-4b03-b520-4573c371610d): created successfully Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77af3a8d-c87d-46ea-a5d2-55b3f9e070a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (4187c066-6a8b-4b25-8da9-b092569fba6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e2957014-a563-4049-b3e9-676597f48306 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:37:02 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c 1073741824" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c Sep 23 00:37:02 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.530s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632691e6-1f87-4f84-af89-90b33dd9548b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa777d2-2791-41fa-9b8f-6a7d9e17bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot ea25fcaf-1718-4efe-b575-ad89c2970946 of volume 3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c (caf7f1e3-e48b-4ed5-b32e-2e483d95612c): created successfully Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa777d2-2791-41fa-9b8f-6a7d9e17bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (74a2e3df-1b54-4738-b0bf-2e3b5ed8250c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46caf4d-4356-4f04-9f71-ebdc938b43d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e3012e2d-1722-497d-badd-c9973679c936 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:37:02 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 Sep 23 00:37:02 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:02 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 1G Sep 23 00:37:02 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 1G" returned: 0 in 0.434s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 Sep 23 00:37:03 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 is being set with open permissions: ugo+rw Sep 23 00:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:03 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 Sep 23 00:37:03 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info Sep 23 00:37:04 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info is being set with open permissions: ugo+rw Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info Sep 23 00:37:04 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.info" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.444s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474451812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8d9f61-a328-40ec-b730-5ec12d871eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume fa8d9f61-a328-40ec-b730-5ec12d871eb9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 1073741824 Sep 23 00:37:04 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ab0a7c49-9cca-4e1d-8be9-41855ac3bcfc tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-ea25fcaf-1718-4efe-b575-ad89c2970946-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-ea25fcaf-1718-4efe-b575-ad89c2970946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-ea25fcaf-1718-4efe-b575-ad89c2970946" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-ea25fcaf-1718-4efe-b575-ad89c2970946" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot ea25fcaf-1718-4efe-b575-ad89c2970946 of volume 3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[23da387a-01c3-4c18-a536-6befd8858fd3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 1073741824" returned: 0 in 0.553s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 Sep 23 00:37:05 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 Sep 23 00:37:05 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278666108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037b0e4d-143e-491b-a13f-12053d90e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef2fb7e210d441ab0ede011bbb47d89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:01Z,use_quota=True,user_id='07bc184dfb6642a3b24b499b6731e1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Creating volume 037b0e4d-143e-491b-a13f-12053d90e293 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b46585f-0e9e-4891-9963-0be99630678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556048a-f594-4cb8-92e7-5c1e220d54f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:05 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 1073741824 Sep 23 00:37:05 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d2999bf-35eb-48d7-a89a-67cc4817e132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 (fa8d9f61-a328-40ec-b730-5ec12d871eb9): created successfully Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8556048a-f594-4cb8-92e7-5c1e220d54f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (f8fcd077-604c-42e9-9a46-8526dc234782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4462c1-3b38-46ae-945d-98ebc9303f6b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9e21c121-1bd8-49e3-bef4-a5bc11738cf4 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:37:05 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 Sep 23 00:37:05 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132" returned: 0 in 0.417s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 1073741824" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 Sep 23 00:37:05 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 Sep 23 00:37:06 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3ed20-6393-4732-8822-b93046b2297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037b0e4d-143e-491b-a13f-12053d90e293', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17576da6-2aa8-4f54-802c-ba098c6a7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Volume volume-037b0e4d-143e-491b-a13f-12053d90e293 (037b0e4d-143e-491b-a13f-12053d90e293): created successfully Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17576da6-2aa8-4f54-802c-ba098c6a7faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Flow 'volume_create_manager' (209297d7-317b-42ca-b70e-875e3bb3ba91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd41c58d-093c-4f03-8d85-75ce2c203bbf tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created volume successfully. Sep 23 00:37:06 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946 Sep 23 00:37:06 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (f4f4272f-2c2b-4060-bcb6-002d4c8344cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeac56e-0224-4e27-924f-3ab18b969a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeac56e-0224-4e27-924f-3ab18b969a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732875160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434bf08d-de07-4a95-887a-6568676e23c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:06Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2770d71-c100-4be9-8e0c-3fa278d70ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2770d71-c100-4be9-8e0c-3fa278d70ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d1ff28-dbae-40bd-8a94-69805acbfa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d1ff28-dbae-40bd-8a94-69805acbfa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434bf08d-de07-4a95-887a-6568676e23c6', 'volume_name': 'volume-434bf08d-de07-4a95-887a-6568676e23c6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1831bc98-60b3-479f-8027-be668993ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1831bc98-60b3-479f-8027-be668993ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d872b9-a044-4a98-b26a-2d5020b88386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Volume 434bf08d-de07-4a95-887a-6568676e23c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434bf08d-de07-4a95-887a-6568676e23c6', 'volume_size': 1} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732875160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434bf08d-de07-4a95-887a-6568676e23c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:06Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Creating volume 434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:06 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 1073741824 Sep 23 00:37:06 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132.ea25fcaf-1718-4efe-b575-ad89c2970946" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-ea25fcaf-1718-4efe-b575-ad89c2970946" released by "_delete_snapshot" :: held 1.703s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" released by "delete_snapshot" :: held 1.730s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Created reservations ['da198d3a-ccb5-474e-a708-5e1f2f708b10', '6553cb5f-304d-4e18-9519-e7117e72a8df', 'f3670e1f-5a90-4257-8018-4f25cab9cde2', '0a4806c7-e110-4084-82c3-5950753763ad', 'd711ee94-b49c-4fb9-9bb9-36018676593c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c118dd4f-7b3f-4669-878b-2e118d58e247 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-ea25fcaf-1718-4efe-b575-ad89c2970946-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-037b0e4d-143e-491b-a13f-12053d90e293-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-037b0e4d-143e-491b-a13f-12053d90e293-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-037b0e4d-143e-491b-a13f-12053d90e293" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-037b0e4d-143e-491b-a13f-12053d90e293" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-3d2999bf-35eb-48d7-a89a-67cc4817e132-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cf8fc-1aaa-49ac-bd44-2512599c53a8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-3d2999bf-35eb-48d7-a89a-67cc4817e132-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 1073741824" returned: 0 in 0.600s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:07 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 Sep 23 00:37:07 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:07 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 Sep 23 00:37:07 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ce7ae5-fa21-453a-81f0-eebb43277614]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 Sep 23 00:37:07 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d872b9-a044-4a98-b26a-2d5020b88386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434bf08d-de07-4a95-887a-6568676e23c6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c37228-c55d-4adf-a8f8-da672276194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Volume volume-434bf08d-de07-4a95-887a-6568676e23c6 (434bf08d-de07-4a95-887a-6568676e23c6): created successfully Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c37228-c55d-4adf-a8f8-da672276194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (f4f4272f-2c2b-4060-bcb6-002d4c8344cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e3aac2ef-123b-4fcf-bdfe-f5cdb1db10e7 tempest-ProjectReaderTests-1076810381 None] Created volume successfully. Sep 23 00:37:07 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293 Sep 23 00:37:07 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132 Sep 23 00:37:07 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-037b0e4d-143e-491b-a13f-12053d90e293" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-037b0e4d-143e-491b-a13f-12053d90e293" released by "delete_volume" :: held 0.762s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['2aa1f1da-e37f-4e7e-ae16-65938bb0c03b', '1500d2e6-53e1-41db-beb8-75a2e35d929d', '37c9bd0a-3513-4af8-ad62-3ebbb2ba1fba', 'd0c1da74-3dec-4e65-8d50-d3dd0566a93f', '13470f26-6b32-423f-8c5f-cef99ae9b722'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:07 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3d2999bf-35eb-48d7-a89a-67cc4817e132" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3d2999bf-35eb-48d7-a89a-67cc4817e132" released by "delete_volume" :: held 0.707s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:08 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Created reservations ['1ae29397-2bac-4053-818c-9423cf89d7b2', '96245c54-be4c-4047-b846-83bdb510ceda', '2e59133f-4981-4f0b-8bb8-8b926e62c53f', '87d3f2b1-2b38-4df1-9277-249e1f867ba2', 'ac20221e-31f1-40e1-90f5-9a2577f04385'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:08 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-fa8d9f61-a328-40ec-b730-5ec12d871eb9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-fa8d9f61-a328-40ec-b730-5ec12d871eb9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-fa8d9f61-a328-40ec-b730-5ec12d871eb9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-fa8d9f61-a328-40ec-b730-5ec12d871eb9" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:08 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc19d8a-5ed0-44af-a6cb-7bb5b9c6bab9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d69ea70-7757-4127-b918-04e5a1b9d6d7 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-037b0e4d-143e-491b-a13f-12053d90e293-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:08 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 Sep 23 00:37:08 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-db8f7ba7-5707-402f-96ea-c7a427553f90 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-3d2999bf-35eb-48d7-a89a-67cc4817e132-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:08 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9 Sep 23 00:37:08 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Creating offline snapshot 71845817-542d-49b2-ac78-51c5c1a5e31f of volume 434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62bd05a-ee35-43ae-adce-a018a47a6ee0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 Sep 23 00:37:08 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-fa8d9f61-a328-40ec-b730-5ec12d871eb9" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-fa8d9f61-a328-40ec-b730-5ec12d871eb9" released by "delete_volume" :: held 0.725s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['a4f1fdf0-9987-4d17-8d49-3f117b1e5494', '3f4cf05e-8f7a-411e-9683-12dbd6b358b2', 'f3cb4a05-c013-475f-aa4e-f0a2e2a7ee04', 'd2f72e3a-bc45-4881-a965-fe062bea5250', '8c69ebd0-76d1-46c1-8751-af03fc374e0d'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:09 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f 1G Sep 23 00:37:09 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.236s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5d5c7323-0f86-4316-a5d4-d2473cc90678 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-fa8d9f61-a328-40ec-b730-5ec12d871eb9-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-caf7f1e3-e48b-4ed5-b32e-2e483d95612c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-caf7f1e3-e48b-4ed5-b32e-2e483d95612c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d616e-d876-4981-ab5d-13805b0224ae]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f 1G" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434bf08d-de07-4a95-887a-6568676e23c6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c Sep 23 00:37:09 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434bf08d-de07-4a95-887a-6568676e23c6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f Sep 23 00:37:09 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:10 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (68ce3f50-b2b4-4c9a-b43d-1a49884f95b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970185e2-527d-4ca9-9134-45ab98a0545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-434bf08d-de07-4a95-887a-6568676e23c6 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f is being set with open permissions: ugo+rw Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c Sep 23 00:37:10 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970185e2-527d-4ca9-9134-45ab98a0545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896474998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b35f153-3809-43de-a98f-09c2651624c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:10Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f Sep 23 00:37:10 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f426b75b-a96e-4f5a-8a31-ccd60270b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f426b75b-a96e-4f5a-8a31-ccd60270b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eaad5e-88a0-4b49-85fb-fe240a077be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eaad5e-88a0-4b49-85fb-fe240a077be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b35f153-3809-43de-a98f-09c2651624c2', 'volume_name': 'volume-3b35f153-3809-43de-a98f-09c2651624c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be2b19e-0726-45b0-9377-43d4a0bc48cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be2b19e-0726-45b0-9377-43d4a0bc48cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc166b3-faf7-4c38-9202-2a3e3baf186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Volume 3b35f153-3809-43de-a98f-09c2651624c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b35f153-3809-43de-a98f-09c2651624c2', 'volume_size': 1} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:10 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-caf7f1e3-e48b-4ed5-b32e-2e483d95612c" released by "delete_volume" :: held 0.739s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:10 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info Sep 23 00:37:10 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['2199a5f5-ddfa-496d-9849-e9759abb3a86', 'ca8939f8-20b9-4b1e-b93b-aeffb60b94f5', '7f0b334f-41c7-4beb-8bcb-315697151f2d', '43457f07-9b2b-497a-bab0-e31484091e11', 'c251dc3c-45f6-4bbc-9c68-e0a9a2a6b06e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:10 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info is being set with open permissions: ugo+rw Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info Sep 23 00:37:10 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-b903a8e3-f5a9-4b03-b520-4573c371610d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-b903a8e3-f5a9-4b03-b520-4573c371610d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:10 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-b903a8e3-f5a9-4b03-b520-4573c371610d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b80608a8-5654-4239-92eb-4a6666192d8f tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-caf7f1e3-e48b-4ed5-b32e-2e483d95612c-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-b903a8e3-f5a9-4b03-b520-4573c371610d" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c0762-0ea9-4293-892b-0c4d9f98e42a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.info" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896474998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b35f153-3809-43de-a98f-09c2651624c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:10Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:10 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Creating volume 3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:10 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:10 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 1073741824 Sep 23 00:37:10 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a196402d-eb43-4b5f-9fc3-3006b29c3587 tempest-ProjectReaderTests-1076810381 None] Create snapshot completed successfully Sep 23 00:37:11 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d Sep 23 00:37:11 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:11 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 1073741824" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-b903a8e3-f5a9-4b03-b520-4573c371610d" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 Sep 23 00:37:11 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-b903a8e3-f5a9-4b03-b520-4573c371610d" released by "delete_volume" :: held 0.688s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['2047f369-44c8-4e77-91b2-912afd0e7219', '8b5f4cd0-814d-4dc0-ab37-fe42254562a2', 'd67c6a93-8232-46f1-aaf8-5d4044b9335f', 'b6d27145-14ac-4a6c-a951-ae7df4846c05', 'f9aa323c-ee45-424c-bc50-36f0f12d68c6'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:11 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:11 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:11 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc166b3-faf7-4c38-9202-2a3e3baf186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b35f153-3809-43de-a98f-09c2651624c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4bba95-7e8e-4f28-a921-ee34fbe97711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Volume volume-3b35f153-3809-43de-a98f-09c2651624c2 (3b35f153-3809-43de-a98f-09c2651624c2): created successfully Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4bba95-7e8e-4f28-a921-ee34fbe97711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (68ce3f50-b2b4-4c9a-b43d-1a49884f95b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ede5e246-38c0-4690-a6b9-db7eb178d37e tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:37:11 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f17e2093-000c-4e1c-9ca4-463cdbb8666c tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-b903a8e3-f5a9-4b03-b520-4573c371610d-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5d477e-2103-4443-b04c-e6a940460468]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde Sep 23 00:37:12 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-71845817-542d-49b2-ac78-51c5c1a5e31f-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-71845817-542d-49b2-ac78-51c5c1a5e31f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-71845817-542d-49b2-ac78-51c5c1a5e31f" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71845817-542d-49b2-ac78-51c5c1a5e31f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Deleting offline snapshot 71845817-542d-49b2-ac78-51c5c1a5e31f of volume 434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] snapshot_file for this snap is: volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467b8c1-fa79-4537-ab28-007f7cb754e5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot 373105e9-e421-46d8-8b14-fa7dbf9410ec of volume 3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97a28a-df99-4641-9bfb-3b36455e2fd9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f Sep 23 00:37:12 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde Sep 23 00:37:12 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 Sep 23 00:37:12 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde" released by "delete_volume" :: held 0.800s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:12 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-434bf08d-de07-4a95-887a-6568676e23c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4fbd52-cd14-4af6-a3d9-42a4fdce6da1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:12 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec 1G Sep 23 00:37:12 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['646bb44a-a7d6-4e08-b171-27cdfc99805a', 'ef47642f-6df6-4183-a62a-ef32b2126aa8', '1f5bbd28-0417-4063-90b2-d51375d4442b', '15a8b864-e717-4e6f-872c-137ba2f434ea', 'd69c7b2c-5efb-406e-9d81-47f4fe3fa1dc'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:12 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 Sep 23 00:37:12 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:13 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-25259df0-73cb-439e-ae90-b2777148e95d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-25259df0-73cb-439e-ae90-b2777148e95d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "cinder-quobyte-25259df0-73cb-439e-ae90-b2777148e95d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-25259df0-73cb-439e-ae90-b2777148e95d" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cea31e-e640-4f55-8248-f45d35b5dfd9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:13 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f Sep 23 00:37:13 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:13 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d Sep 23 00:37:13 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5406d4b-5621-47d2-8abc-b261559ddc08 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-c0c5ba0b-78e8-42f6-82a7-3c011e0e5fde-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:13 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec 1G" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b35f153-3809-43de-a98f-09c2651624c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b35f153-3809-43de-a98f-09c2651624c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec Sep 23 00:37:13 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f" returned: 0 in 0.374s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d Sep 23 00:37:13 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f Sep 23 00:37:13 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b35f153-3809-43de-a98f-09c2651624c2 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec is being set with open permissions: ugo+rw Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:13 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec Sep 23 00:37:13 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:13 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-25259df0-73cb-439e-ae90-b2777148e95d" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-quobyte-25259df0-73cb-439e-ae90-b2777148e95d" released by "delete_volume" :: held 0.750s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:13 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6.71845817-542d-49b2-ac78-51c5c1a5e31f" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71845817-542d-49b2-ac78-51c5c1a5e31f" released by "_delete_snapshot" :: held 1.657s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:14 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" released by "delete_snapshot" :: held 1.696s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info Sep 23 00:37:14 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Created reservations ['075a3415-00ee-4e0c-8b03-599b8723c8bc', 'ac9662ff-b25e-40ee-8fb6-c0cf494e8250', 'b8c0d191-fad4-4659-9b7d-a9f8c305e1f3', 'a3af1772-c713-492c-a8af-8957ff8b779d', '8e6bffef-8bd0-4fe5-a139-20f0f619e8f0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Created reservations ['8f67e074-4d8b-4b75-931d-9485dfa4bbc2', '8adeceb2-beb3-4f5e-b6d5-fb8cf0ab499a', '85f4a8aa-9771-469c-84b8-f7d1e91d0458', '3a6b4db9-88b3-485e-af5b-ac9c6f85d4a8', '4cdd81e2-b2d2-437d-8f70-506219331ed8'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:14 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Delete snapshot completed successfully. Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-96c7a8b6-2c27-4fd3-85b2-8b8367efd9b5 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-71845817-542d-49b2-ac78-51c5c1a5e31f-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:14 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info is being set with open permissions: ugo+rw Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info Sep 23 00:37:14 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:14 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-434bf08d-de07-4a95-887a-6568676e23c6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Deleted volume successfully. Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-434bf08d-de07-4a95-887a-6568676e23c6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6b9ff955-bf3a-4e90-afd7-e03fc90dbc74 tempest-CreateVolumesFromSourceVolumeTest-1158335883 None] Lock "cinder-25259df0-73cb-439e-ae90-b2777148e95d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42367c38-f79e-4672-b537-36ca1dff56a8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:14 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.info" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-abc3132d-f302-45f8-a2bf-25f87c00229c tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:14 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 Sep 23 00:37:14 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:15 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:15 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6 Sep 23 00:37:15 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:15 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-434bf08d-de07-4a95-887a-6568676e23c6" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-434bf08d-de07-4a95-887a-6568676e23c6" released by "delete_volume" :: held 0.759s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Created reservations ['2feb556d-4a3a-484e-a718-3277ad6ee2c5', '37b58b43-0b7a-4341-b3b4-8c4dbb189a2f', 'abba0482-71c6-4124-8dad-7318444bf75d', '02147ab2-ef1b-48a4-8a5a-1d6a2df0d799', '490faecf-4c58-42c6-833d-f6c9e8291245'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-373105e9-e421-46d8-8b14-fa7dbf9410ec-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-373105e9-e421-46d8-8b14-fa7dbf9410ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-373105e9-e421-46d8-8b14-fa7dbf9410ec" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:15 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:15 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-373105e9-e421-46d8-8b14-fa7dbf9410ec" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot 373105e9-e421-46d8-8b14-fa7dbf9410ec of volume 3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c1f54-52a7-4679-842e-09d751261581]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:15 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec Sep 23 00:37:15 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:15 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Deleted volume successfully. Sep 23 00:37:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c3a0fe4-4c52-4fd7-adc4-7609692132a3 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-434bf08d-de07-4a95-887a-6568676e23c6-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:16 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec" returned: 0 in 0.511s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b35f153-3809-43de-a98f-09c2651624c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[405e4196-7a1b-464c-8c36-3d73d823222b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:16 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 Sep 23 00:37:16 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (bdcd6323-694a-493f-8ede-1a0c8f584652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a470df92-5454-4267-a395-42851b562a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a470df92-5454-4267-a395-42851b562a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109664121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:16Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfead518-fef0-46e0-b359-dbad4b6f6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfead518-fef0-46e0-b359-dbad4b6f6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c307c14-a2a8-4a47-b526-6464bc03ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c307c14-a2a8-4a47-b526-6464bc03ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057', 'volume_name': 'volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68958a4b-4e4e-4021-838d-817d2ee60472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68958a4b-4e4e-4021-838d-817d2ee60472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb73b81b-280c-47b7-800f-a9e4617969ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Volume 2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057', 'volume_size': 1} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109664121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:16Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Creating volume 2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:16 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 1073741824 Sep 23 00:37:16 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:16 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:16 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec Sep 23 00:37:16 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:17 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 1073741824" returned: 0 in 0.540s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:17 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec Sep 23 00:37:17 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:17 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 Sep 23 00:37:17 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:17 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2.373105e9-e421-46d8-8b14-fa7dbf9410ec" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-373105e9-e421-46d8-8b14-fa7dbf9410ec" released by "_delete_snapshot" :: held 1.794s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" released by "delete_snapshot" :: held 1.831s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb73b81b-280c-47b7-800f-a9e4617969ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47644237-7cc8-498e-bfd3-9cc31b8008b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Volume volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 (2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057): created successfully Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47644237-7cc8-498e-bfd3-9cc31b8008b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (bdcd6323-694a-493f-8ede-1a0c8f584652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e890a097-9d6c-4bcc-be14-524efa8920a8 tempest-ProjectReaderTests-1076810381 None] Created volume successfully. Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Created reservations ['b359fd40-7cc7-42b2-af50-aabc11bb549e', 'af2cd8da-470b-461e-af3b-bde2e0b69e7a', '8dd2c1f2-f4f9-4221-93f2-48cc7c8c8f65', '8b3cd41f-efcb-4526-860f-a34c9a56f496', 'a12359c0-6ad2-462b-81a6-85d00800dd67'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6d81006b-c0cf-40cc-8db6-565789d37b14 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-373105e9-e421-46d8-8b14-fa7dbf9410ec-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-3b35f153-3809-43de-a98f-09c2651624c2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "cinder-3b35f153-3809-43de-a98f-09c2651624c2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[927adf5b-9e84-4928-a2cf-0a872d141911]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Flow 'volume_create_manager' (b34a3412-209c-480a-9a08-677e08c460db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f89ba-df26-4081-aaf2-6ed212a8f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f89ba-df26-4081-aaf2-6ed212a8f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cec5ed-9bcd-4306-bbf9-0cfbebd0e022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a397f7244b4c8995d7b8184004f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:18Z,use_quota=True,user_id='7c913f84e1a04322aa35553149a433c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db53725-b9ef-456c-ae13-b1adb6f66f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db53725-b9ef-456c-ae13-b1adb6f66f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525a4ee3-c1ba-43bb-99da-0ea84e38d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 Sep 23 00:37:18 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525a4ee3-c1ba-43bb-99da-0ea84e38d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cec5ed-9bcd-4306-bbf9-0cfbebd0e022', 'volume_name': 'volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92a5074-cdb9-4d75-9e1d-42657e7d9e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92a5074-cdb9-4d75-9e1d-42657e7d9e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c1ccdd-378f-454a-bdb6-7e7811ecfb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Volume 68cec5ed-9bcd-4306-bbf9-0cfbebd0e022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022', 'volume_size': 1} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68cec5ed-9bcd-4306-bbf9-0cfbebd0e022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a397f7244b4c8995d7b8184004f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:18Z,use_quota=True,user_id='7c913f84e1a04322aa35553149a433c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Creating volume 68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 1073741824 Sep 23 00:37:18 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2 Sep 23 00:37:18 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 1073741824" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 Sep 23 00:37:18 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-3b35f153-3809-43de-a98f-09c2651624c2" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-3b35f153-3809-43de-a98f-09c2651624c2" released by "delete_volume" :: held 0.812s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Created reservations ['27ff42ce-be9d-463e-8001-3b45aec4879a', '89e52644-5c51-4333-b21b-bb317ea77c53', '19713d10-1630-4c69-8b47-4d673531a606', '572e3248-cb55-4ab3-a87f-9f37bca7c964', 'd581a011-27e3-4eed-ba0a-317c084b4fc9'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:18 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:18 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.137s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Creating offline snapshot 712a520d-3229-4968-8aa9-70b79f83296e of volume 2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c1ccdd-378f-454a-bdb6-7e7811ecfb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599e321a-c88b-403b-a188-a493dccc08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[783df7a2-3cd5-4e98-ae7f-005bddd03a9c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Volume volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 (68cec5ed-9bcd-4306-bbf9-0cfbebd0e022): created successfully Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599e321a-c88b-403b-a188-a493dccc08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Flow 'volume_create_manager' (b34a3412-209c-480a-9a08-677e08c460db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c0736aa-07bb-4119-8075-9f6e2e2d9a7f tempest-CinderUnicodeTest-413517565 None] Created volume successfully. Sep 23 00:37:19 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 Sep 23 00:37:19 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83621e33-a637-487e-bdd0-10692f9f392f tempest-ProjectMemberTests-1860301013 None] Lock "cinder-3b35f153-3809-43de-a98f-09c2651624c2-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:19 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e 1G Sep 23 00:37:19 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (8f6d99f3-3f35-487c-b50d-828cd9cb0e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d63965f-6f31-4d8b-bcd9-0344434c9991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d63965f-6f31-4d8b-bcd9-0344434c9991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361384844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ba4e18-cf1b-44b7-b413-8890fe5d25e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:19Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d613455-f605-4b54-9fff-e508bc1c88ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d613455-f605-4b54-9fff-e508bc1c88ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec283a25-8ffc-4b3c-bfc9-1aed49427131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec283a25-8ffc-4b3c-bfc9-1aed49427131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ba4e18-cf1b-44b7-b413-8890fe5d25e8', 'volume_name': 'volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2648ecdf-735e-4888-812f-81b350bf443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2648ecdf-735e-4888-812f-81b350bf443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933bf83b-9fb4-4568-ada3-d1094997194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Volume e3ba4e18-cf1b-44b7-b413-8890fe5d25e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8', 'volume_size': 1} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:19 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e 1G" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:19 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e Sep 23 00:37:19 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e is being set with open permissions: ugo+rw Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e Sep 23 00:37:20 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e" returned: 0 in 0.238s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info Sep 23 00:37:20 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Flow 'volume_create_manager' (08d7c872-733a-44c5-9087-3d3f1a719c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f48c6b6-2250-410f-a6d0-e59c32dd16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f48c6b6-2250-410f-a6d0-e59c32dd16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-320492328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0677b9f1-0432-45bf-8917-45a6e4b169c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a397f7244b4c8995d7b8184004f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:20Z,use_quota=True,user_id='7c913f84e1a04322aa35553149a433c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b4799e-027b-42f6-9043-86b36fd76041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b4799e-027b-42f6-9043-86b36fd76041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b8254-0fb1-4367-992d-c527afae7529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676b8254-0fb1-4367-992d-c527afae7529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0677b9f1-0432-45bf-8917-45a6e4b169c8', 'volume_name': 'volume-0677b9f1-0432-45bf-8917-45a6e4b169c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ebf6d-070d-44f1-9fa2-5d564dcd6cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ebf6d-070d-44f1-9fa2-5d564dcd6cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a2b1b5-4afa-476b-ba67-7d899ee1ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Volume 0677b9f1-0432-45bf-8917-45a6e4b169c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0677b9f1-0432-45bf-8917-45a6e4b169c8', 'volume_size': 1} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:20 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info is being set with open permissions: ugo+rw Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info Sep 23 00:37:20 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.info" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361384844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ba4e18-cf1b-44b7-b413-8890fe5d25e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:19Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Creating volume e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:20 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 1073741824 Sep 23 00:37:20 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4876301f-ef5f-44b4-96fc-6362fb3222ee tempest-ProjectReaderTests-1076810381 None] Create snapshot completed successfully Sep 23 00:37:21 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 1073741824" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:21 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 Sep 23 00:37:21 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-320492328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0677b9f1-0432-45bf-8917-45a6e4b169c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a397f7244b4c8995d7b8184004f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:20Z,use_quota=True,user_id='7c913f84e1a04322aa35553149a433c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Creating volume 0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:21 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:21 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 1073741824 Sep 23 00:37:21 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933bf83b-9fb4-4568-ada3-d1094997194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085e3296-7386-4020-8518-ecaac1cc59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Volume volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 (e3ba4e18-cf1b-44b7-b413-8890fe5d25e8): created successfully Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085e3296-7386-4020-8518-ecaac1cc59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (8f6d99f3-3f35-487c-b50d-828cd9cb0e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0205a2e2-89af-44dc-a5eb-c3e9dbcd8a7c tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-712a520d-3229-4968-8aa9-70b79f83296e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-712a520d-3229-4968-8aa9-70b79f83296e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-712a520d-3229-4968-8aa9-70b79f83296e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-712a520d-3229-4968-8aa9-70b79f83296e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Deleting offline snapshot 712a520d-3229-4968-8aa9-70b79f83296e of volume 2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] snapshot_file for this snap is: volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097dfb2-acc9-4e65-bc14-5e578ed06425]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e Sep 23 00:37:22 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 1073741824" returned: 0 in 0.498s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 Sep 23 00:37:22 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26ec0a-2345-4ef9-b100-64362c4c58e0]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a2b1b5-4afa-476b-ba67-7d899ee1ff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0677b9f1-0432-45bf-8917-45a6e4b169c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ae2b5-5ff3-4f7e-9aa0-e2b1ddd679a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Volume volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 (0677b9f1-0432-45bf-8917-45a6e4b169c8): created successfully Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ae2b5-5ff3-4f7e-9aa0-e2b1ddd679a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Flow 'volume_create_manager' (08d7c872-733a-44c5-9087-3d3f1a719c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0a5e690f-ff13-4327-81aa-f9c7d50c317a tempest-CinderUnicodeTest-413517565 None] Created volume successfully. Sep 23 00:37:22 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 Sep 23 00:37:22 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot f0f427fa-b6d9-4bb0-b752-c242f08473d2 of volume e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c4195-8a3b-4d86-86f2-75d49b972649]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" returned: 0 in 0.403s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:22 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e Sep 23 00:37:22 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:22 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 Sep 23 00:37:22 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:23 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e Sep 23 00:37:23 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:23 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 1G Sep 23 00:37:23 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:23 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057.712a520d-3229-4968-8aa9-70b79f83296e" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-712a520d-3229-4968-8aa9-70b79f83296e" released by "_delete_snapshot" :: held 1.530s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" released by "delete_snapshot" :: held 1.556s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Created reservations ['532d1576-c0b4-4a3b-9272-fb91c8d475fb', '2ba4ef8a-35ef-4c4b-b2ad-5304787567de', '428a62de-ab94-45c8-86bc-7ea9126de1cb', 'a6726200-70a6-4545-a72b-7cce8a10263c', '13f40fbc-5fdf-4b41-bb06-950fb406860b'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Delete snapshot completed successfully. Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-730c6875-f9e6-43f2-aacb-901ab5a898ad tempest-ProjectReaderTests-1076810381 None] Lock "cinder-712a520d-3229-4968-8aa9-70b79f83296e-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:23 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 1G" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:23 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 Sep 23 00:37:23 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:24 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 is being set with open permissions: ugo+rw Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 Sep 23 00:37:24 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[501ab1fe-ee2b-4db5-97b8-cec5ab1bd017]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 Sep 23 00:37:24 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info Sep 23 00:37:24 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info is being set with open permissions: ugo+rw Sep 23 00:37:24 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info Sep 23 00:37:24 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057 Sep 23 00:37:24 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:24 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.info" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057" released by "delete_volume" :: held 0.734s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Creating offline snapshot e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 of volume 0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f1b6bc47-9554-4156-833f-4e937c3924b2 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb69faf5-db69-4ad7-820f-821b216d2892]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Created reservations ['3d44cc64-e490-49d1-bbd2-d58caec89c72', 'e6793e5b-9bea-4c28-83c5-76fb3de00c0e', '920c3731-e1fe-44cb-8b22-0273373cb40a', '6e3479c5-ff9d-4cb0-b0c4-51ffc2ba8581', 'b332c9b1-b042-4e22-8475-76e3df933a3a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:25 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 Sep 23 00:37:25 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:25 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:25 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:25 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Deleted volume successfully. Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f5a9218a-4185-4cac-8e60-463e5c9963b8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-2c4934c9-0a5c-4c6e-b0a6-b81a1fe78057-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:25 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:25 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 1G Sep 23 00:37:25 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (d5354136-e121-4ed5-bd4f-fc6bfbb5ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a73aaa3-703b-4957-8370-4d68fefe0a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a73aaa3-703b-4957-8370-4d68fefe0a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521934093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f7c4f0-03d9-46b5-9d14-7af7c3630ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:26Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e499ede-413f-40df-93e8-2f89f74e7478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e499ede-413f-40df-93e8-2f89f74e7478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d68f8f-8cad-4fd8-9382-916de34aff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d68f8f-8cad-4fd8-9382-916de34aff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f7c4f0-03d9-46b5-9d14-7af7c3630ca9', 'volume_name': 'volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b788677b-5066-4824-b0bf-95906701e942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b788677b-5066-4824-b0bf-95906701e942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:25 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca89ebdc-7148-423f-b993-8cfcbc3073a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Volume 71f7c4f0-03d9-46b5-9d14-7af7c3630ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9', 'volume_size': 1} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 1G" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:25 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 Sep 23 00:37:25 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-f0f427fa-b6d9-4bb0-b752-c242f08473d2-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-f0f427fa-b6d9-4bb0-b752-c242f08473d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-f0f427fa-b6d9-4bb0-b752-c242f08473d2" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-f0f427fa-b6d9-4bb0-b752-c242f08473d2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot f0f427fa-b6d9-4bb0-b752-c242f08473d2 of volume e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00068bf0-06dc-45b8-99af-375503dbd75b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 is being set with open permissions: ugo+rw Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 Sep 23 00:37:26 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 Sep 23 00:37:26 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:26 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info Sep 23 00:37:26 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e3e7fa-d8b7-4cce-adb4-ead3792c4851]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 Sep 23 00:37:26 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info is being set with open permissions: ugo+rw Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info Sep 23 00:37:26 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:26 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:26 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 Sep 23 00:37:26 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.info" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521934093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f7c4f0-03d9-46b5-9d14-7af7c3630ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:26Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Creating volume 71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 1073741824 Sep 23 00:37:27 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb1d0d55-0272-43d9-bada-d61ab64e71a3 tempest-CinderUnicodeTest-413517565 None] Create snapshot completed successfully Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-quobyte-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Deleting offline snapshot e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 of volume 0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] snapshot_file for this snap is: volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb623390-98e2-48b5-9693-94af6f1b9573]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2 Sep 23 00:37:27 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 Sep 23 00:37:27 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 1073741824" returned: 0 in 0.521s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 Sep 23 00:37:27 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8.f0f427fa-b6d9-4bb0-b752-c242f08473d2" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-f0f427fa-b6d9-4bb0-b752-c242f08473d2" released by "_delete_snapshot" :: held 1.596s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" released by "delete_snapshot" :: held 1.628s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:27 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0677b9f1-0432-45bf-8917-45a6e4b169c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf8479-2b80-4b1c-9fd6-b5c0e2fb8948]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Created reservations ['de2b46ce-138e-448d-a20d-cad85f542575', '85dfbc35-a5aa-467e-a2bb-d0e4ecac3d28', '8f976b00-9b24-4b87-939e-2d24da3fb5dd', 'a1ad3e8b-d134-4a2c-aa53-be9ec53e32bc', '18ca5bea-8567-423a-a4e6-9ad67f32066e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-da7c2998-cab9-48d6-8af9-26742fbfbd4c tempest-ProjectMemberTests-1860301013 None] Lock "cinder-f0f427fa-b6d9-4bb0-b752-c242f08473d2-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:27 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:27 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 Sep 23 00:37:27 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca89ebdc-7148-423f-b993-8cfcbc3073a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92de31c-986d-4127-8f94-8f63caac32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Volume volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 (71f7c4f0-03d9-46b5-9d14-7af7c3630ca9): created successfully Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92de31c-986d-4127-8f94-8f63caac32ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (d5354136-e121-4ed5-bd4f-fc6bfbb5ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2e022ddf-5897-49ec-9f83-34346c019eab tempest-ProjectReaderTests-1076810381 None] Created volume successfully. Sep 23 00:37:28 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8" returned: 0 in 0.392s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 Sep 23 00:37:28 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[72110188-880d-46bb-8550-b4c481698a66]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 Sep 23 00:37:28 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33 Sep 23 00:37:28 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" returned: 0 in 0.369s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:28 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8 Sep 23 00:37:28 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:28 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8.e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33" released by "_delete_snapshot" :: held 1.531s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" released by "delete_snapshot" :: held 1.554s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Created reservations ['b248cb3b-d328-46bd-930e-53f34f185667', 'b7f000d4-d5c4-4bdd-b735-528e7ea861cf', 'db84d058-2bd9-4aa8-b7bf-9121ff2d455f', 'ab20fa1d-3f3e-4b55-9e81-b7e61ebfc0fe', 'b2f8a438-ef55-43d8-8a7b-f89d63ace05e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Delete snapshot completed successfully. Sep 23 00:37:28 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5bee4aca-8d28-4ea5-b2da-0b4bfe9336eb tempest-CinderUnicodeTest-413517565 None] Lock "cinder-e7aabf9c-3cc0-4e8f-a4b9-9ce312bdba33-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8" released by "delete_volume" :: held 0.708s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Created reservations ['3ac8010f-39fc-4aa7-b4b2-76e083244265', '6925c5e4-fef2-4a3b-9916-ef69d8f6bf0d', 'b17333fb-5bdc-4954-9474-f348f82d0886', '445bd152-b804-4981-a61a-1c6ccf222fc4', '5c2f116a-fb67-4b9e-b464-3ca5bd697d17'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:29 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Creating offline snapshot 0350f84b-3166-4bd0-bb37-a6885f895c3d of volume 71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c8c41-0c4d-41d3-8a1a-31156cea5848]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 Sep 23 00:37:29 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-0677b9f1-0432-45bf-8917-45a6e4b169c8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-0677b9f1-0432-45bf-8917-45a6e4b169c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a3fd724f-db8c-4e32-8935-d4cbdefd2224 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-e3ba4e18-cf1b-44b7-b413-8890fe5d25e8-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b582d6e-cc3e-475e-9944-86383b6d9aba]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" returned: 0 in 0.451s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:29 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 Sep 23 00:37:29 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d 1G Sep 23 00:37:29 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:30 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (2fc224d7-672d-4daa-806d-a542ce23801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bcd3c6-d7bc-4622-ac13-629537ee51c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8 Sep 23 00:37:30 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18bcd3c6-d7bc-4622-ac13-629537ee51c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1140059582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49910ffa-06f2-4843-916c-3e21f79159cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:30Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8075813-a6f6-4293-bdb1-9294a2c8edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8075813-a6f6-4293-bdb1-9294a2c8edff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b00bfd-fdbb-4680-9da9-a550928cd9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b00bfd-fdbb-4680-9da9-a550928cd9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49910ffa-06f2-4843-916c-3e21f79159cb', 'volume_name': 'volume-49910ffa-06f2-4843-916c-3e21f79159cb', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc0528-801a-4d7f-8225-eaaf0f7bd3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc0528-801a-4d7f-8225-eaaf0f7bd3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65887337-1ec6-4863-8f2a-99e2aa8c2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Volume 49910ffa-06f2-4843-916c-3e21f79159cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49910ffa-06f2-4843-916c-3e21f79159cb', 'volume_size': 1} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:30 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d 1G" returned: 0 in 0.461s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d Sep 23 00:37:30 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-0677b9f1-0432-45bf-8917-45a6e4b169c8" returned: 0 in 0.254s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-0677b9f1-0432-45bf-8917-45a6e4b169c8" released by "delete_volume" :: held 0.798s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Created reservations ['e357bebd-b6d7-4050-af33-41eed6db3b50', 'a648ed39-f2b4-4ca9-bd7b-9dedf5b5f6e4', 'f0221e18-233f-4147-9375-24433e1c49d2', 'a850ef7a-4235-41ef-b6a3-633f5e4ba285', 'b5054505-408e-4e0c-831f-1481fdaafdca'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d is being set with open permissions: ugo+rw Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:30 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d Sep 23 00:37:30 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "cinder-quobyte-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7c668-1b78-417d-aa20-ca9396cd9ef8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.291s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Deleted volume successfully. Sep 23 00:37:30 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf8d8c9c-9f57-4965-b3ef-3edbe47ae177 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-0677b9f1-0432-45bf-8917-45a6e4b169c8-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:30 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info Sep 23 00:37:30 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:30 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 Sep 23 00:37:30 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:31 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info is being set with open permissions: ugo+rw Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:31 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info Sep 23 00:37:31 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:31 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:31 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022 Sep 23 00:37:31 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:31 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.info" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1140059582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49910ffa-06f2-4843-916c-3e21f79159cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:30Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Creating volume 49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb 1073741824 Sep 23 00:37:31 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-quobyte-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022" released by "delete_volume" :: held 0.707s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c37c84ce-af84-47b4-aaa9-5bd38ac0cc9e tempest-ProjectReaderTests-1076810381 None] Create snapshot completed successfully Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Created reservations ['ad1867d5-b537-45c4-a25b-22e34221df3b', 'e9402426-1c00-4d16-a8ee-807eb31b7cdc', '346da338-afda-489b-93a0-fc42e6b781ff', '975c56e0-de44-4f80-a9c1-818868fb6edd', '5a7afc8f-ebe5-4a7d-a1a2-423fb669b60e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:31 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:31 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:31 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Deleted volume successfully. Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-137d953a-9ad6-468e-bc4f-ac0ed57b74c0 tempest-CinderUnicodeTest-413517565 None] Lock "cinder-68cec5ed-9bcd-4306-bbf9-0cfbebd0e022-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:31 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb 1073741824" returned: 0 in 0.476s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:31 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb Sep 23 00:37:31 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:32 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65887337-1ec6-4863-8f2a-99e2aa8c2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49910ffa-06f2-4843-916c-3e21f79159cb', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f960d1-0cc7-432b-8663-6dd252efe5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Volume volume-49910ffa-06f2-4843-916c-3e21f79159cb (49910ffa-06f2-4843-916c-3e21f79159cb): created successfully Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f960d1-0cc7-432b-8663-6dd252efe5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (2fc224d7-672d-4daa-806d-a542ce23801b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-46bc3fa3-e7ef-4366-8ad5-8f00167581f6 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-0350f84b-3166-4bd0-bb37-a6885f895c3d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-0350f84b-3166-4bd0-bb37-a6885f895c3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-0350f84b-3166-4bd0-bb37-a6885f895c3d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-0350f84b-3166-4bd0-bb37-a6885f895c3d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Deleting offline snapshot 0350f84b-3166-4bd0-bb37-a6885f895c3d of volume 71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] snapshot_file for this snap is: volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749591d-0717-4063-9d06-98f09562c7e1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:32 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d Sep 23 00:37:32 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:32 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f6cf0f-47b3-47d9-835f-3b080a3d7070]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 Sep 23 00:37:33 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:33 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" returned: 0 in 0.464s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d Sep 23 00:37:33 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot 4ce9d101-e4a3-486d-9228-5ca9f0286c81 of volume 49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20326612-bf2f-42d6-8ae0-f4819be937dd]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb Sep 23 00:37:33 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d Sep 23 00:37:33 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:33 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb" returned: 0 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:33 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 1G Sep 23 00:37:33 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:34 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9.0350f84b-3166-4bd0-bb37-a6885f895c3d" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-0350f84b-3166-4bd0-bb37-a6885f895c3d" released by "_delete_snapshot" :: held 1.678s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" released by "delete_snapshot" :: held 1.713s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Created reservations ['fe8898f3-3d06-4a6d-9c28-a3d81346075e', 'a4bc0d55-1525-4c6c-a8f7-8ec0f0f7a1c1', 'ffc0fa02-e7ac-492a-a4f2-f3a4e6cbb47f', '0026f75d-c604-497a-9ea8-b376d102764c', 'c8c206a3-dbbe-4d57-a97a-03a0cfee102f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Delete snapshot completed successfully. Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2758727c-711c-4efe-99de-fff642a64ea0 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-0350f84b-3166-4bd0-bb37-a6885f895c3d-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:34 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 1G" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49910ffa-06f2-4843-916c-3e21f79159cb -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:34 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49910ffa-06f2-4843-916c-3e21f79159cb -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 Sep 23 00:37:34 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:34 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49910ffa-06f2-4843-916c-3e21f79159cb -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:34 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 is being set with open permissions: ugo+rw Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e991005a-717a-40d8-9104-200dce179bda]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:34 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 Sep 23 00:37:34 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:34 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 Sep 23 00:37:34 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:35 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:35 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info Sep 23 00:37:35 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:35 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:35 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9 Sep 23 00:37:35 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:35 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info is being set with open permissions: ugo+rw Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:35 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info Sep 23 00:37:35 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5931048c-d3b7-4ac5-b36f-d397e11bea20 tempest-ProjectAdminTests-424736862 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:37:35 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9" released by "delete_volume" :: held 0.760s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Created reservations ['16cc062e-b5aa-4e26-980a-6a9ce57a7932', '81f364a4-81fd-41b0-aeb4-4b8ceaca8094', '0f46eed4-75e4-4581-aace-24ac0c85ed1a', 'fbbfbfbd-f34a-4a9e-b148-5731572a2d02', 'bb68bd74-d313-42e7-b483-75721997d2d3'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:35 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.info" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:35 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d31a4874-2139-4c5f-ac0f-1166edba688e tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:35 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Deleted volume successfully. Sep 23 00:37:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dca8421-1fc9-449e-a6f9-2f9944e948ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-71f7c4f0-03d9-46b5-9d14-7af7c3630ca9-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (27839ad7-0bfc-4e76-a44b-c128a8403061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ffb9b-64b8-46b0-a947-d12b8f63cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ffb9b-64b8-46b0-a947-d12b8f63cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1005494262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eecf42-3cd1-474b-a9c0-dfea78ac3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:36Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565ad2ac-1108-4a85-90d5-3c7d797c6c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565ad2ac-1108-4a85-90d5-3c7d797c6c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761ca478-0615-4b7c-bc07-d75df4253e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761ca478-0615-4b7c-bc07-d75df4253e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63eecf42-3cd1-474b-a9c0-dfea78ac3082', 'volume_name': 'volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deedf31d-a52b-44dd-8c63-c68dca3dd98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deedf31d-a52b-44dd-8c63-c68dca3dd98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f62a76f-b009-4dea-b4a7-f05899f7ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Volume 63eecf42-3cd1-474b-a9c0-dfea78ac3082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082', 'volume_size': 1} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1005494262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eecf42-3cd1-474b-a9c0-dfea78ac3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:36Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Creating volume 63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:36 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 1073741824 Sep 23 00:37:36 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-4ce9d101-e4a3-486d-9228-5ca9f0286c81-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-4ce9d101-e4a3-486d-9228-5ca9f0286c81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-4ce9d101-e4a3-486d-9228-5ca9f0286c81" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-4ce9d101-e4a3-486d-9228-5ca9f0286c81" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot 4ce9d101-e4a3-486d-9228-5ca9f0286c81 of volume 49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a103e9f-a15a-45ff-a219-1f5d2bc5f64f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:36 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 Sep 23 00:37:36 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:36 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 1073741824" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:36 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 Sep 23 00:37:36 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49910ffa-06f2-4843-916c-3e21f79159cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2a4f6-4cb6-4546-853a-1170872f96c1]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb Sep 23 00:37:37 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f62a76f-b009-4dea-b4a7-f05899f7ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9e770-593d-4e85-a73d-5bb790eaed64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Volume volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 (63eecf42-3cd1-474b-a9c0-dfea78ac3082): created successfully Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea9e770-593d-4e85-a73d-5bb790eaed64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (27839ad7-0bfc-4e76-a44b-c128a8403061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-da9b57d4-e639-4ad5-bb38-7c20a9d0d7f9 tempest-ProjectReaderTests-1076810381 None] Created volume successfully. Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:37 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb" returned: 0 in 0.426s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 Sep 23 00:37:37 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:37 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.262s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:37:37 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:37 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81 Sep 23 00:37:37 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb.4ce9d101-e4a3-486d-9228-5ca9f0286c81" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-4ce9d101-e4a3-486d-9228-5ca9f0286c81" released by "_delete_snapshot" :: held 1.584s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" released by "delete_snapshot" :: held 1.615s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Created reservations ['229cdf8b-519a-4900-b557-7021ac9fd2b8', '9df0750f-68b5-464b-a8d3-429bbe17ed1c', 'e800aabb-d81b-4dc2-a0d6-c95f102ed536', 'ae13af2b-c356-4775-ac07-3c4f49eadd9b', '9fa0065c-60ca-4e9e-bd2d-25ed8d6a6d30'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ca9b1ea8-21f6-4e04-a0fc-6a49da557f74 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-4ce9d101-e4a3-486d-9228-5ca9f0286c81-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Creating offline snapshot bd18adf6-8451-41b5-90b9-9f57031302a3 of volume 63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[181a3f9d-88df-4fd1-8ae7-8d10568bb7f9]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:38 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 Sep 23 00:37:38 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-49910ffa-06f2-4843-916c-3e21f79159cb-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-49910ffa-06f2-4843-916c-3e21f79159cb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[741aab3a-1ea7-4bbc-89c5-ee583dc7c45f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082" returned: 0 in 0.434s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb Sep 23 00:37:39 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 1G Sep 23 00:37:39 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb Sep 23 00:37:39 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 1G" returned: 0 in 0.492s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 Sep 23 00:37:39 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-49910ffa-06f2-4843-916c-3e21f79159cb" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-49910ffa-06f2-4843-916c-3e21f79159cb" released by "delete_volume" :: held 0.763s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Created reservations ['fd146939-352e-4225-b365-f84a471db2ee', '88510494-2079-4b28-975a-b9278b7ea7e9', '12560507-585d-4998-a8c0-a4e41f5df156', '3fa140d6-43b0-48f1-a0fa-75bd92c32624', 'b76fb228-921c-4d2c-b61b-beea10cc33ed'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:39 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:39 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 is being set with open permissions: ugo+rw Sep 23 00:37:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:39 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 Sep 23 00:37:39 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4dce8984-8cda-45ec-b1c2-19873011d92b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-49910ffa-06f2-4843-916c-3e21f79159cb-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:40 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info Sep 23 00:37:40 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info is being set with open permissions: ugo+rw Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info Sep 23 00:37:40 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (9dcb7325-af99-4f33-a425-fa9b6943f727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37a506f-ea67-4bd7-8078-ea9bfa8c0970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37a506f-ea67-4bd7-8078-ea9bfa8c0970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646201468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e9f774-24fb-444a-94f5-077a9b45b36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:40Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d48d1c-9d41-4368-b62e-79a6e6f5efcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d48d1c-9d41-4368-b62e-79a6e6f5efcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d91d8c-257d-43a1-bc29-e9c9857fd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d91d8c-257d-43a1-bc29-e9c9857fd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e9f774-24fb-444a-94f5-077a9b45b36f', 'volume_name': 'volume-32e9f774-24fb-444a-94f5-077a9b45b36f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e985c596-fccf-4178-a799-1aeb0f6c13bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e985c596-fccf-4178-a799-1aeb0f6c13bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb0aea-35df-4080-a110-6b92456fdc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Volume 32e9f774-24fb-444a-94f5-077a9b45b36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e9f774-24fb-444a-94f5-077a9b45b36f', 'volume_size': 1} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:40 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.info" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646201468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e9f774-24fb-444a-94f5-077a9b45b36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:40Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Creating volume 32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:40 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:40 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f 1073741824 Sep 23 00:37:40 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a7057f2f-c7d3-40a9-808f-23a0670a1e6b tempest-ProjectReaderTests-1076810381 None] Create snapshot completed successfully Sep 23 00:37:41 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f 1073741824" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f Sep 23 00:37:41 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:41 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bb0aea-35df-4080-a110-6b92456fdc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e9f774-24fb-444a-94f5-077a9b45b36f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045a56ea-e507-47bc-806b-5e4bc1f2ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Volume volume-32e9f774-24fb-444a-94f5-077a9b45b36f (32e9f774-24fb-444a-94f5-077a9b45b36f): created successfully Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045a56ea-e507-47bc-806b-5e4bc1f2ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (9dcb7325-af99-4f33-a425-fa9b6943f727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-32d42ef5-e9d6-4664-bdcd-a4c7e3ba75e3 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-bd18adf6-8451-41b5-90b9-9f57031302a3-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-bd18adf6-8451-41b5-90b9-9f57031302a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-bd18adf6-8451-41b5-90b9-9f57031302a3" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-bd18adf6-8451-41b5-90b9-9f57031302a3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Deleting offline snapshot bd18adf6-8451-41b5-90b9-9f57031302a3 of volume 63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] snapshot_file for this snap is: volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1acaaeb-13de-4d0c-83b6-89c61d87df0b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 Sep 23 00:37:41 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c3599c-d4a4-4a67-8a91-207c52ea05d6]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 Sep 23 00:37:42 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082" returned: 0 in 0.403s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 Sep 23 00:37:42 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e of volume 32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[165391db-92e5-4e83-98e9-ab59c0c81e47]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f Sep 23 00:37:42 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3 Sep 23 00:37:43 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f" returned: 0 in 0.403s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e 1G Sep 23 00:37:43 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082.bd18adf6-8451-41b5-90b9-9f57031302a3" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-bd18adf6-8451-41b5-90b9-9f57031302a3" released by "_delete_snapshot" :: held 1.596s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" released by "delete_snapshot" :: held 1.629s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Created reservations ['f1fc2c19-bd2a-4071-83bb-a2f59ec9017f', 'b350b374-6037-4c52-87a4-31582c1d9016', '4df5df51-8083-43f6-8e22-d6f3aee3b1a5', 'a12ecd2e-b395-459f-a143-230f98fb59de', 'a716c787-f323-4bc7-a30a-04aa8c93e195'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Delete snapshot completed successfully. Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-764b5719-1aba-4463-bbdd-4af52f1f24ae tempest-ProjectReaderTests-1076810381 None] Lock "cinder-bd18adf6-8451-41b5-90b9-9f57031302a3-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:43 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e 1G" returned: 0 in 0.546s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e9f774-24fb-444a-94f5-077a9b45b36f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:43 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e9f774-24fb-444a-94f5-077a9b45b36f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e Sep 23 00:37:43 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-63eecf42-3cd1-474b-a9c0-dfea78ac3082-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-63eecf42-3cd1-474b-a9c0-dfea78ac3082-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df9189-6829-4f65-8710-37cd274ae80d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32e9f774-24fb-444a-94f5-077a9b45b36f -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e is being set with open permissions: ugo+rw Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e Sep 23 00:37:44 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 Sep 23 00:37:44 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082" returned: 0 in 0.349s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info Sep 23 00:37:44 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082 Sep 23 00:37:44 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info is being set with open permissions: ugo+rw Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-63eecf42-3cd1-474b-a9c0-dfea78ac3082" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info Sep 23 00:37:44 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-63eecf42-3cd1-474b-a9c0-dfea78ac3082" released by "delete_volume" :: held 0.658s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Created reservations ['81cdbc36-6d93-4104-ae8f-752632fc0904', '475885f4-ef45-4148-846d-e8f86b462a53', '3e97b524-46b5-405f-a470-f65c1ebe51f2', '26b71e01-45a4-40eb-ac8b-70966c808301', '9023b1fb-4df1-4ccc-b0d9-55d0c98a29b5'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:44 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.info" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-68cfb185-1f42-4d01-b028-df6ef2d829c3 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:45 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Deleted volume successfully. Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a0eb789-b873-4274-99c4-d34c19c389c8 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-63eecf42-3cd1-474b-a9c0-dfea78ac3082-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (878edf04-c57c-46ea-a892-05c24b5698c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4623d9a-5805-4fbe-b5f1-b7e1cd70d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4623d9a-5805-4fbe-b5f1-b7e1cd70d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066721989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c35640-db4f-4f5c-9965-6e0497853b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:46Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915d00a-94ed-4913-984a-cea0f875f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9915d00a-94ed-4913-984a-cea0f875f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f3f939-dca4-41cb-8108-fe798029e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f3f939-dca4-41cb-8108-fe798029e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c35640-db4f-4f5c-9965-6e0497853b55', 'volume_name': 'volume-73c35640-db4f-4f5c-9965-6e0497853b55', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064e92db-8555-42ad-8d15-871fa6093f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (064e92db-8555-42ad-8d15-871fa6093f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaed53e-bdb1-4bc8-a873-811453af3990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Volume 73c35640-db4f-4f5c-9965-6e0497853b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c35640-db4f-4f5c-9965-6e0497853b55', 'volume_size': 1} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066721989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c35640-db4f-4f5c-9965-6e0497853b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc74fb0c3504c26994647d81fe48100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:46Z,use_quota=True,user_id='c5e8b13515914c909f141dfe9e1882ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Creating volume 73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 1073741824 Sep 23 00:37:45 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e of volume 32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c818f6ab-e3f0-453f-9cfa-002346ba37ff]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e Sep 23 00:37:46 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 1073741824" returned: 0 in 0.511s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 Sep 23 00:37:46 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32e9f774-24fb-444a-94f5-077a9b45b36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85436e7f-c0eb-4624-9dd3-b13e7061b1ee]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aaed53e-bdb1-4bc8-a873-811453af3990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c35640-db4f-4f5c-9965-6e0497853b55', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b803b-a66a-410e-b489-d2c58cc9bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Volume volume-73c35640-db4f-4f5c-9965-6e0497853b55 (73c35640-db4f-4f5c-9965-6e0497853b55): created successfully Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b803b-a66a-410e-b489-d2c58cc9bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Flow 'volume_create_manager' (878edf04-c57c-46ea-a892-05c24b5698c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-46e19541-eec9-4a27-ab7f-95e0a1459ae2 tempest-ProjectReaderTests-1076810381 None] Created volume successfully. Sep 23 00:37:46 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f Sep 23 00:37:46 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:46 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e Sep 23 00:37:46 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:47 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:47 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e Sep 23 00:37:47 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:47 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f.f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e" released by "_delete_snapshot" :: held 1.506s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" released by "delete_snapshot" :: held 1.532s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Created reservations ['44f1ef3c-ee57-42b7-8c52-b6612031326e', '433b7bbc-3fc9-4cb4-9666-de775437b5fa', 'b4221cef-d382-49a8-a177-f23ce7752ee0', '97ff576e-4574-43a1-8bcb-3065a25565ea', 'e3ec9e88-7750-4af9-9ebf-a478b661cc7a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bed149c8-2062-4182-97ab-19ba86812993 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-f2ee8fc9-ce4d-411a-bc4f-c6a4f758744e-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Creating offline snapshot 6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd of volume 73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebf28c-4c5f-47a5-9b14-d53891e71600]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-32e9f774-24fb-444a-94f5-077a9b45b36f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-32e9f774-24fb-444a-94f5-077a9b45b36f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:48 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 Sep 23 00:37:48 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa89a26e-8c5d-4b10-b4a1-a4fe32b35583]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f Sep 23 00:37:48 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd 1G Sep 23 00:37:48 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f" returned: 0 in 0.392s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f Sep 23 00:37:48 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd 1G" returned: 0 in 0.493s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c35640-db4f-4f5c-9965-6e0497853b55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-32e9f774-24fb-444a-94f5-077a9b45b36f" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c35640-db4f-4f5c-9965-6e0497853b55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd Sep 23 00:37:48 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-32e9f774-24fb-444a-94f5-077a9b45b36f" released by "delete_volume" :: held 0.758s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Created reservations ['d8c6d73f-a1ed-451c-8f77-8d4d328acf05', '0500f67a-802a-4c21-b9bc-d8ea336dba6b', '8e7f3d3e-4b38-4d9a-b033-19b0c32d2ec0', '757a2978-5065-481c-be94-218d413e46fa', '6bb6427f-20f2-48c4-8628-764c78973748'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:49 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c35640-db4f-4f5c-9965-6e0497853b55 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd is being set with open permissions: ugo+rw Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd Sep 23 00:37:49 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7b228b57-e4d0-4f4f-8fb9-c382ddbb1c10 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-32e9f774-24fb-444a-94f5-077a9b45b36f-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:49 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:49 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info Sep 23 00:37:49 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (f9a4b940-7b2a-45cf-a948-69d778a1e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:50 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115053c0-451a-4e13-9713-bc3d2906666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info is being set with open permissions: ugo+rw Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115053c0-451a-4e13-9713-bc3d2906666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025263085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd987ea8-0089-485d-8543-4cef0427b558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:50Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:50 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info Sep 23 00:37:50 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a2a599-7126-4edc-b028-c9149fa5b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a2a599-7126-4edc-b028-c9149fa5b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c89b9-75ea-4bd8-95fa-6c1565ee2eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c89b9-75ea-4bd8-95fa-6c1565ee2eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd987ea8-0089-485d-8543-4cef0427b558', 'volume_name': 'volume-bd987ea8-0089-485d-8543-4cef0427b558', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7259ad00-3d02-41f5-8bcf-6f0dedba7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7259ad00-3d02-41f5-8bcf-6f0dedba7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371d8ae0-0078-4980-8a52-664b51bb21ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Volume bd987ea8-0089-485d-8543-4cef0427b558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd987ea8-0089-485d-8543-4cef0427b558', 'volume_size': 1} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:50 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.info" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.219s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025263085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd987ea8-0089-485d-8543-4cef0427b558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:50Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Creating volume bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 1073741824 Sep 23 00:37:50 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0d50e055-e589-4838-929d-b19f2399d9bf tempest-ProjectReaderTests-1076810381 None] Create snapshot completed successfully Sep 23 00:37:50 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 1073741824" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:50 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 Sep 23 00:37:50 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:51 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371d8ae0-0078-4980-8a52-664b51bb21ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd987ea8-0089-485d-8543-4cef0427b558', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4694366a-f06d-482c-a14c-205733798d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Volume volume-bd987ea8-0089-485d-8543-4cef0427b558 (bd987ea8-0089-485d-8543-4cef0427b558): created successfully Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4694366a-f06d-482c-a14c-205733798d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (f9a4b940-7b2a-45cf-a948-69d778a1e81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-10eb323b-c303-4d79-ba17-e78606b23829 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Deleting offline snapshot 6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd of volume 73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] snapshot_file for this snap is: volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102c678-98a4-4723-a313-80c563b4e033]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:51 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd Sep 23 00:37:51 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:51 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" returned: 0 in 0.359s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c35640-db4f-4f5c-9965-6e0497853b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a49471-dbc8-489b-a3aa-fc478e27d54f]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:51 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 Sep 23 00:37:51 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd Sep 23 00:37:52 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 of volume bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb76cb0-3745-41f5-b54f-d260297a6bcc]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 Sep 23 00:37:52 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd Sep 23 00:37:52 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:52 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 1G Sep 23 00:37:52 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:52 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55.6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd" released by "_delete_snapshot" :: held 1.535s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" released by "delete_snapshot" :: held 1.563s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Created reservations ['769aa9ab-9867-4a32-bce5-1ec847c545a3', '4bd04297-581d-4ca8-bdb2-cf8c3c85322f', '2561b61c-8846-4c83-94f5-0d58e84636b5', '335ff133-7a23-451d-bf8a-e1e9e4ca29b1', '2190bd34-aa37-426b-8fe8-99d28b4284bc'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Delete snapshot completed successfully. Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bd55aa39-7e2d-467b-8202-fbe024ac8af9 tempest-ProjectReaderTests-1076810381 None] Lock "cinder-6a2333ad-5d9c-45cc-b9c6-21ea47b0d9dd-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:53 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 1G" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd987ea8-0089-485d-8543-4cef0427b558 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd987ea8-0089-485d-8543-4cef0427b558 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 Sep 23 00:37:53 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-73c35640-db4f-4f5c-9965-6e0497853b55-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "cinder-73c35640-db4f-4f5c-9965-6e0497853b55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Acquiring lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:53 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd987ea8-0089-485d-8543-4cef0427b558 -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 is being set with open permissions: ugo+rw Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[70078a54-5260-495c-9a63-0ad4655aa71b]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 Sep 23 00:37:53 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 Sep 23 00:37:53 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:53 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info Sep 23 00:37:53 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:53 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:54 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55 Sep 23 00:37:54 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:54 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info is being set with open permissions: ugo+rw Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:54 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info Sep 23 00:37:54 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:54 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-73c35640-db4f-4f5c-9965-6e0497853b55" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "cinder-quobyte-73c35640-db4f-4f5c-9965-6e0497853b55" released by "delete_volume" :: held 0.763s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Created reservations ['c32cf32d-2ecd-4f79-99b2-33c98f5a5c1c', '54eeec6b-0889-41e0-a8cb-155552fb8480', 'c0cc7f30-8b3c-4b90-a1e5-1063b8fed418', '414a64aa-001c-4792-921c-167c4ce3da3e', '5fae5672-af42-4099-8c1b-65f3f6310f6f'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:54 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.info" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d4327568-3c40-4c67-a3ec-9b2107589315 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:37:54 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:54 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:54 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Deleted volume successfully. Sep 23 00:37:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2aee2a3f-e154-43c6-849a-24de9f1b116f tempest-ProjectReaderTests-1076810381 None] Lock "cinder-73c35640-db4f-4f5c-9965-6e0497853b55-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 of volume bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b7ec9f-d158-4430-a677-1368f6b1872a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 Sep 23 00:37:55 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd987ea8-0089-485d-8543-4cef0427b558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac85163-ff00-4dad-b9c1-db017d23e50c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 Sep 23 00:37:56 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 Sep 23 00:37:56 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044 Sep 23 00:37:56 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558.eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044" released by "_delete_snapshot" :: held 1.663s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" released by "delete_snapshot" :: held 1.690s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Created reservations ['7b5d2908-39a4-4bb6-97b3-42c05e092fc7', '81f94334-22f1-4dfa-a221-ebee4af2b14b', '386d609f-3795-4730-b96c-8ac150d134c8', '8c9e0260-3fc3-48ea-8ea9-d06f9ace7d48', '6c560f98-53f8-427b-81ab-0354835398ee'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b6c2485a-5f2f-4825-ae50-8dcc7e30250b tempest-ProjectMemberTests-1860301013 None] Lock "cinder-eaa369e3-1ce5-4a36-a8e7-3fd5577c3044-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-bd987ea8-0089-485d-8543-4cef0427b558-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-bd987ea8-0089-485d-8543-4cef0427b558-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc301e-c92d-4153-a2c7-257d74c7a6b5]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 Sep 23 00:37:57 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:58 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:58 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558 Sep 23 00:37:58 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:58 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-bd987ea8-0089-485d-8543-4cef0427b558" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-bd987ea8-0089-485d-8543-4cef0427b558" released by "delete_volume" :: held 0.779s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Created reservations ['899deba7-5821-408a-87c9-9dbb44715661', '18df0076-edb5-4b71-8990-d5cd7696192b', '7663e97d-9ab8-46d4-a091-19a6f3f597cf', 'aad47555-cc0b-498b-adef-4fad0b9c60b4', '9ae608d3-cbd2-4780-bf6c-7e592dcaca56'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:58 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:37:58 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:58 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:37:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bc8c3bc2-1add-4495-9293-0a416b0afdc1 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-bd987ea8-0089-485d-8543-4cef0427b558-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (a610997f-d7f5-4183-820a-e795a2ffe7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5f9d9f-7f2b-4a0a-b572-b7bd65ce1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5f9d9f-7f2b-4a0a-b572-b7bd65ce1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353122781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3e2222-ea47-457e-9480-9501144c076d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:59Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f179c-31af-47e7-a9d3-909019549eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f179c-31af-47e7-a9d3-909019549eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c351450-ba45-4763-acf6-6963baffc7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c351450-ba45-4763-acf6-6963baffc7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3e2222-ea47-457e-9480-9501144c076d', 'volume_name': 'volume-9e3e2222-ea47-457e-9480-9501144c076d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5aa5e3-79d0-4754-a485-1fddd5749c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5aa5e3-79d0-4754-a485-1fddd5749c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527363f7-38ac-4495-8f74-ded8cc9f0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Volume 9e3e2222-ea47-457e-9480-9501144c076d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3e2222-ea47-457e-9480-9501144c076d', 'volume_size': 1} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353122781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3e2222-ea47-457e-9480-9501144c076d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d6b070e0284d759ec8df188b3e0d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:59Z,use_quota=True,user_id='c47166e5d5bb4683be96e81f217d6722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Creating volume 9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d 1073741824 Sep 23 00:37:59 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d 1073741824" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=241,cinder:INSERT=89,cinder:UPDATE=316,cinder:DELETE=20 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d Sep 23 00:38:00 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527363f7-38ac-4495-8f74-ded8cc9f0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3e2222-ea47-457e-9480-9501144c076d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1524df-6678-4eec-b7eb-d9fa7eeb7384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=250,cinder:UPDATE=321,cinder:INSERT=96,cinder:DELETE=28 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Volume volume-9e3e2222-ea47-457e-9480-9501144c076d (9e3e2222-ea47-457e-9480-9501144c076d): created successfully Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1524df-6678-4eec-b7eb-d9fa7eeb7384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Flow 'volume_create_manager' (a610997f-d7f5-4183-820a-e795a2ffe7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-221ad9e0-2eeb-4153-9bea-1eefa538b9c1 tempest-ProjectMemberTests-1860301013 None] Created volume successfully. Sep 23 00:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Creating offline snapshot e042db73-7811-4b2c-9333-fc4dbabf7741 of volume 9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c104b3-4841-46c7-8fe2-a4c786779b8a]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:01 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d Sep 23 00:38:01 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 1G Sep 23 00:38:02 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 1G" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3e2222-ea47-457e-9480-9501144c076d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3e2222-ea47-457e-9480-9501144c076d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 Sep 23 00:38:02 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:02 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e3e2222-ea47-457e-9480-9501144c076d -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:02 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 is being set with open permissions: ugo+rw Sep 23 00:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 Sep 23 00:38:02 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:03 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info Sep 23 00:38:03 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info is being set with open permissions: ugo+rw Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:03 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info Sep 23 00:38:03 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.info" returned: 0 in 0.237s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5dd195b7-b3b0-4d38-8b48-90da4d05f963 tempest-ProjectMemberTests-1860301013 None] Create snapshot completed successfully Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-e042db73-7811-4b2c-9333-fc4dbabf7741-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-e042db73-7811-4b2c-9333-fc4dbabf7741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-e042db73-7811-4b2c-9333-fc4dbabf7741" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e042db73-7811-4b2c-9333-fc4dbabf7741" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Deleting offline snapshot e042db73-7811-4b2c-9333-fc4dbabf7741 of volume 9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] snapshot_file for this snap is: volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7313dabc-4710-40f9-b52a-0506b2520e53]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 Sep 23 00:38:04 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e3e2222-ea47-457e-9480-9501144c076d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0baa4f-8190-44b3-aa06-0567c0a99c55]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d Sep 23 00:38:04 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:04 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d" returned: 0 in 0.374s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:04 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 Sep 23 00:38:04 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:05 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:05 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741 Sep 23 00:38:05 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:05 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d.e042db73-7811-4b2c-9333-fc4dbabf7741" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-e042db73-7811-4b2c-9333-fc4dbabf7741" released by "_delete_snapshot" :: held 1.454s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" released by "delete_snapshot" :: held 1.475s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Created reservations ['924936fd-f24a-4317-b244-60b54fd05e06', '4f0d8a31-6cbd-4a05-8865-9f07374669c8', '9f90e5cf-be46-4212-ad05-bb10f61f2a39', 'a0ceb3cd-9896-470f-880d-0762a15de4ce', '56bd58fd-99ba-4cf1-afac-61796bfe4e7c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Delete snapshot completed successfully. Sep 23 00:38:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-57fa6a3c-689b-4ec8-a756-366691686140 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-e042db73-7811-4b2c-9333-fc4dbabf7741-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-9e3e2222-ea47-457e-9480-9501144c076d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-9e3e2222-ea47-457e-9480-9501144c076d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8888b68-20b4-4784-9ed7-6c39186ea048]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:06 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d Sep 23 00:38:06 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:06 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d" returned: 0 in 0.365s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:06 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d Sep 23 00:38:06 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:06 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-9e3e2222-ea47-457e-9480-9501144c076d" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-quobyte-9e3e2222-ea47-457e-9480-9501144c076d" released by "delete_volume" :: held 0.678s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Created reservations ['554ce0bd-af14-46cf-adcc-f852ecfdcfc8', '769dda56-0c3a-470a-9686-3cfe7c77d766', 'd0b7f2d0-9668-4ebe-91d6-c64e468640e7', '224b78b1-da91-4823-aab9-16b2277d0df4', '349662cc-3d73-49bf-99eb-2c93d360e7df'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:07 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:07 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:07 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Deleted volume successfully. Sep 23 00:38:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9527817d-b93f-4905-867a-d8453e77ace0 tempest-ProjectMemberTests-1860301013 None] Lock "cinder-9e3e2222-ea47-457e-9480-9501144c076d-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (b1f20363-c431-4de5-9b3a-02b0ef88a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e396cabd-1bcf-4f7b-b619-f501361dd709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e396cabd-1bcf-4f7b-b619-f501361dd709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227754711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac384963-c319-4b84-b58b-08bad9f9a5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:09Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ec7abc-4d11-4149-a4b0-2dd5bd1f4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ec7abc-4d11-4149-a4b0-2dd5bd1f4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f686150-9935-494a-81f2-0a7684bcee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f686150-9935-494a-81f2-0a7684bcee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac384963-c319-4b84-b58b-08bad9f9a5ff', 'volume_name': 'volume-ac384963-c319-4b84-b58b-08bad9f9a5ff', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b595fb1f-5c6d-4254-b6b9-0ad762271c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b595fb1f-5c6d-4254-b6b9-0ad762271c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8835823-46b5-4f75-9e58-068498f74ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Volume ac384963-c319-4b84-b58b-08bad9f9a5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac384963-c319-4b84-b58b-08bad9f9a5ff', 'volume_size': 1} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227754711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac384963-c319-4b84-b58b-08bad9f9a5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:09Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Creating volume ac384963-c319-4b84-b58b-08bad9f9a5ff {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:08 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff 1073741824 Sep 23 00:38:08 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff 1073741824" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:09 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff Sep 23 00:38:09 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:09 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8835823-46b5-4f75-9e58-068498f74ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac384963-c319-4b84-b58b-08bad9f9a5ff', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22d6161-b67e-41a4-8481-9f6db589e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Volume volume-ac384963-c319-4b84-b58b-08bad9f9a5ff (ac384963-c319-4b84-b58b-08bad9f9a5ff): created successfully Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d22d6161-b67e-41a4-8481-9f6db589e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (b1f20363-c431-4de5-9b3a-02b0ef88a250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fbfdcce8-505c-454c-8e3e-0b9a0f7a575f tempest-ProjectReaderTests-1124809976 None] Created volume successfully. Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Flow 'volume_create_manager' (a0b767c7-82f0-42f2-9025-e7c9e80f3cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285a1ef5-5e26-4d90-ba04-319bd4291eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285a1ef5-5e26-4d90-ba04-319bd4291eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598453903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faa8f02-ade5-42e3-bf0d-53899856b375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32eb4ae22dd74669b98dc2b48bfe3bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:11Z,use_quota=True,user_id='f525b887721348bb99028ddc8358556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be73680-1427-4cf7-9634-4c822ae60862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be73680-1427-4cf7-9634-4c822ae60862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7dd3fe-7744-4bd0-9f32-23f972572c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7dd3fe-7744-4bd0-9f32-23f972572c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4faa8f02-ade5-42e3-bf0d-53899856b375', 'volume_name': 'volume-4faa8f02-ade5-42e3-bf0d-53899856b375', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77c4d98-9b80-4dea-adea-ef80f2420695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77c4d98-9b80-4dea-adea-ef80f2420695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2373b981-bb54-4747-9976-8ba7b4bcaa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Volume 4faa8f02-ade5-42e3-bf0d-53899856b375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4faa8f02-ade5-42e3-bf0d-53899856b375', 'volume_size': 1} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598453903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faa8f02-ade5-42e3-bf0d-53899856b375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32eb4ae22dd74669b98dc2b48bfe3bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:11Z,use_quota=True,user_id='f525b887721348bb99028ddc8358556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Creating volume 4faa8f02-ade5-42e3-bf0d-53899856b375 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-ac384963-c319-4b84-b58b-08bad9f9a5ff-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:11 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 1073741824 Sep 23 00:38:11 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-ac384963-c319-4b84-b58b-08bad9f9a5ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-quobyte-ac384963-c319-4b84-b58b-08bad9f9a5ff" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-ac384963-c319-4b84-b58b-08bad9f9a5ff" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0bb03-1331-4f55-8a7e-95b442d0bdc8]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff Sep 23 00:38:11 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 1073741824" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 Sep 23 00:38:11 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:11 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff Sep 23 00:38:11 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:11 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2373b981-bb54-4747-9976-8ba7b4bcaa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4faa8f02-ade5-42e3-bf0d-53899856b375', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34051b2-d83e-4ba1-95e6-99a4066dbe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Volume volume-4faa8f02-ade5-42e3-bf0d-53899856b375 (4faa8f02-ade5-42e3-bf0d-53899856b375): created successfully Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34051b2-d83e-4ba1-95e6-99a4066dbe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Flow 'volume_create_manager' (a0b767c7-82f0-42f2-9025-e7c9e80f3cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0a45f2ea-ea14-4918-8658-bb4dd2c5b70d tempest-ProjectReaderTests-635174313 None] Created volume successfully. Sep 23 00:38:11 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ac384963-c319-4b84-b58b-08bad9f9a5ff" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-ac384963-c319-4b84-b58b-08bad9f9a5ff" released by "delete_volume" :: held 0.706s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Created reservations ['c1f364f3-3adc-4792-90d6-52a5fe0d4488', 'fa7c8c0a-774c-42cf-a68a-6edc70978f07', 'a7fab11d-51fa-4727-811f-10fff9d7f2b3', 'efaf7b66-f6de-4399-a8af-9d94dfdc8147', '0b0b5db9-6a3f-4375-9300-7fdcc2270acc'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:12 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Acquiring lock "cinder-4faa8f02-ade5-42e3-bf0d-53899856b375-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "cinder-4faa8f02-ade5-42e3-bf0d-53899856b375-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Acquiring lock "cinder-quobyte-4faa8f02-ade5-42e3-bf0d-53899856b375" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:12 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.262s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Deleted volume successfully. Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "cinder-quobyte-4faa8f02-ade5-42e3-bf0d-53899856b375" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e4a43e42-37fe-460e-9409-5dbc7e513411 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-ac384963-c319-4b84-b58b-08bad9f9a5ff-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d2a03f-ddb5-47f0-9f93-6ba1fcefc396]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 Sep 23 00:38:12 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:12 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (420c2280-272f-4fe3-b5d4-dfe4083bb212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe35f4b-73f8-4768-a34a-714b56cb4040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375" returned: 0 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375 Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe35f4b-73f8-4768-a34a-714b56cb4040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645303470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91536cd9-c8e7-47d3-9a09-4160c89696e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:13Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:12 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa65f278-5f4c-4cbe-a87a-26995835b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa65f278-5f4c-4cbe-a87a-26995835b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85bc339-fcb1-4f9c-a292-a97720e57d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85bc339-fcb1-4f9c-a292-a97720e57d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91536cd9-c8e7-47d3-9a09-4160c89696e6', 'volume_name': 'volume-91536cd9-c8e7-47d3-9a09-4160c89696e6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71110e63-670b-415b-8288-3fe0be82a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71110e63-670b-415b-8288-3fe0be82a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c65f8-665a-46b8-ab05-5949a131eb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:12 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Volume 91536cd9-c8e7-47d3-9a09-4160c89696e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91536cd9-c8e7-47d3-9a09-4160c89696e6', 'volume_size': 1} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645303470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91536cd9-c8e7-47d3-9a09-4160c89696e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:13Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Creating volume 91536cd9-c8e7-47d3-9a09-4160c89696e6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:12 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:12 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 1073741824 Sep 23 00:38:12 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:12 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-4faa8f02-ade5-42e3-bf0d-53899856b375" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "cinder-quobyte-4faa8f02-ade5-42e3-bf0d-53899856b375" released by "delete_volume" :: held 0.708s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Created reservations ['866ff000-e9b9-4dd4-a615-2f1f528353bc', 'd6c0ea7e-460c-4a8e-a9d6-b669ec523b49', 'ca975f90-19e9-4d72-a99e-2f91403defbf', '5f9a439d-09c7-4bc3-b915-9ae5bf96a993', 'ec618a2d-08c9-41f1-afc9-aa3343032c9c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:13 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 1073741824" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:13 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 Sep 23 00:38:13 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:13 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Deleted volume successfully. Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f7d6770-9fef-48fe-b483-88f416e45dbb tempest-ProjectReaderTests-635174313 None] Lock "cinder-4faa8f02-ade5-42e3-bf0d-53899856b375-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:13 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c65f8-665a-46b8-ab05-5949a131eb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91536cd9-c8e7-47d3-9a09-4160c89696e6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a089582-75a4-4168-83eb-631b388dee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Volume volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 (91536cd9-c8e7-47d3-9a09-4160c89696e6): created successfully Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a089582-75a4-4168-83eb-631b388dee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (420c2280-272f-4fe3-b5d4-dfe4083bb212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e338d87f-8bb8-40e7-adae-2ba3ad29b94d tempest-ProjectReaderTests-1124809976 None] Created volume successfully. Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Flow 'volume_create_manager' (52c1b607-abf2-40d0-8742-d6c286a13d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6397d81f-3217-4da0-af0a-3f3e78b90c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6397d81f-3217-4da0-af0a-3f3e78b90c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465620289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed975690-a962-4293-a612-f73460cd8e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32eb4ae22dd74669b98dc2b48bfe3bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:14Z,use_quota=True,user_id='f525b887721348bb99028ddc8358556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd7166b-3388-4b26-b1c3-47e9ad6f3346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd7166b-3388-4b26-b1c3-47e9ad6f3346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba85a7c-7db7-4a5e-9912-18a1e136fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba85a7c-7db7-4a5e-9912-18a1e136fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed975690-a962-4293-a612-f73460cd8e7e', 'volume_name': 'volume-ed975690-a962-4293-a612-f73460cd8e7e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa396ea5-b6e3-4ef7-87e7-653603f96d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa396ea5-b6e3-4ef7-87e7-653603f96d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf2ca03-6f36-4715-8c24-4f512262e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Volume ed975690-a962-4293-a612-f73460cd8e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed975690-a962-4293-a612-f73460cd8e7e', 'volume_size': 1} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465620289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed975690-a962-4293-a612-f73460cd8e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32eb4ae22dd74669b98dc2b48bfe3bec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:14Z,use_quota=True,user_id='f525b887721348bb99028ddc8358556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Creating volume ed975690-a962-4293-a612-f73460cd8e7e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e 1073741824 Sep 23 00:38:14 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:14 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e 1073741824" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:14 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e Sep 23 00:38:14 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:14 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e" returned: 0 in 0.236s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf2ca03-6f36-4715-8c24-4f512262e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed975690-a962-4293-a612-f73460cd8e7e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee271c-fa6c-4038-be19-28ec3e719c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Volume volume-ed975690-a962-4293-a612-f73460cd8e7e (ed975690-a962-4293-a612-f73460cd8e7e): created successfully Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee271c-fa6c-4038-be19-28ec3e719c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Flow 'volume_create_manager' (52c1b607-abf2-40d0-8742-d6c286a13d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-046034c9-87b3-4bcc-87ab-f1eb1a6cd305 tempest-ProjectReaderTests-635174313 None] Created volume successfully. Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-91536cd9-c8e7-47d3-9a09-4160c89696e6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "cinder-91536cd9-c8e7-47d3-9a09-4160c89696e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-quobyte-91536cd9-c8e7-47d3-9a09-4160c89696e6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-91536cd9-c8e7-47d3-9a09-4160c89696e6" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Acquiring lock "cinder-ed975690-a962-4293-a612-f73460cd8e7e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b190f-ce6d-4c66-a10f-f38e847c59ab]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "cinder-ed975690-a962-4293-a612-f73460cd8e7e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Acquiring lock "cinder-quobyte-ed975690-a962-4293-a612-f73460cd8e7e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "cinder-quobyte-ed975690-a962-4293-a612-f73460cd8e7e" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e884b9d-5adc-4dbe-9187-1c2dc35985ae]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 Sep 23 00:38:15 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e Sep 23 00:38:15 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6" returned: 0 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6 Sep 23 00:38:15 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e" returned: 0 in 0.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e Sep 23 00:38:15 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:15 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-91536cd9-c8e7-47d3-9a09-4160c89696e6" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-91536cd9-c8e7-47d3-9a09-4160c89696e6" released by "delete_volume" :: held 0.716s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:15 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-ed975690-a962-4293-a612-f73460cd8e7e" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "cinder-quobyte-ed975690-a962-4293-a612-f73460cd8e7e" released by "delete_volume" :: held 0.653s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Created reservations ['c2596244-233b-4e1d-82a7-2b0894816f5e', '9f78d769-548c-4d64-810f-f8f865775f13', 'd2736fcb-b64f-48a6-b933-985e576e28a8', '4d3017a8-97d4-438f-b89f-e6e68d2593a7', 'd9464818-7fc8-4ec2-9640-1db0f6fff876'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Sep 23 00:38:15 devstack cinder-volume[86731]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Sep 23 00:38:15 devstack cinder-volume[86731]: FROM reservations Sep 23 00:38:15 devstack cinder-volume[86731]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s, %(uuid_1_5)s) FOR UPDATE] Sep 23 00:38:15 devstack cinder-volume[86731]: [parameters: {'uuid_1_1': 'c2596244-233b-4e1d-82a7-2b0894816f5e', 'uuid_1_2': '9f78d769-548c-4d64-810f-f8f865775f13', 'uuid_1_3': 'd2736fcb-b64f-48a6-b933-985e576e28a8', 'uuid_1_4': '4d3017a8-97d4-438f-b89f-e6e68d2593a7', 'uuid_1_5': 'd9464818-7fc8-4ec2-9640-1db0f6fff876'}] Sep 23 00:38:15 devstack cinder-volume[86731]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=86731) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_db.api [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=86731) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Created reservations ['2ca1dec8-c2ba-48b4-b834-be4a2e9b8a25', '8774a752-5a4d-4911-b754-d191902b54d6', '3e63eeb3-3bcb-46a2-974e-6f5e51b6592a', 'abb0f5f2-918b-4d61-81b8-de25bfcee476', '6fbecf66-9ae9-49dc-bf64-f766417c8e4c'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:15 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:15 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:16 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Deleted volume successfully. Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0900a876-5a93-4702-83a1-59907089f1c4 tempest-ProjectReaderTests-635174313 None] Lock "cinder-ed975690-a962-4293-a612-f73460cd8e7e-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (811450e2-5a26-429f-b099-f8029c963aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d3f274-8b3f-46b0-92e6-babe8517c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d3f274-8b3f-46b0-92e6-babe8517c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460867890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2853005f-b553-404e-884f-41b402dd1333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:17Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ba210e-d82c-4f77-bd9f-a223460c3f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ba210e-d82c-4f77-bd9f-a223460c3f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4e1e11-64d3-414f-b206-802767d690b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4e1e11-64d3-414f-b206-802767d690b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2853005f-b553-404e-884f-41b402dd1333', 'volume_name': 'volume-2853005f-b553-404e-884f-41b402dd1333', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34931a3-a9bb-4eff-8799-8f9332f33a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34931a3-a9bb-4eff-8799-8f9332f33a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36581c0-5b7a-4b9e-89cd-3307b0e3323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Volume 2853005f-b553-404e-884f-41b402dd1333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2853005f-b553-404e-884f-41b402dd1333', 'volume_size': 1} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460867890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2853005f-b553-404e-884f-41b402dd1333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:17Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Creating volume 2853005f-b553-404e-884f-41b402dd1333 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:16 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 1073741824 Sep 23 00:38:16 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:16 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:16 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:17 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 1073741824" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Deleted volume successfully. Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ccaa70c6-bc71-4622-a262-98ab28878fdd tempest-ProjectReaderTests-1124809976 None] Lock "cinder-91536cd9-c8e7-47d3-9a09-4160c89696e6-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:17 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 Sep 23 00:38:17 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:17 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36581c0-5b7a-4b9e-89cd-3307b0e3323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2853005f-b553-404e-884f-41b402dd1333', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea0cd74-447d-4704-b23a-a57dceb2d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Volume volume-2853005f-b553-404e-884f-41b402dd1333 (2853005f-b553-404e-884f-41b402dd1333): created successfully Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea0cd74-447d-4704-b23a-a57dceb2d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (811450e2-5a26-429f-b099-f8029c963aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bbffa1da-b2e3-4823-aaca-ed74ecef08b6 tempest-ProjectReaderTests-1124809976 None] Created volume successfully. Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-2853005f-b553-404e-884f-41b402dd1333-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-2853005f-b553-404e-884f-41b402dd1333-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-quobyte-2853005f-b553-404e-884f-41b402dd1333" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-2853005f-b553-404e-884f-41b402dd1333" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c957e6-5e8d-4ba0-9fde-99d3f683bf15]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:18 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 Sep 23 00:38:18 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:19 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:19 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333 Sep 23 00:38:19 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:19 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-2853005f-b553-404e-884f-41b402dd1333" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-2853005f-b553-404e-884f-41b402dd1333" released by "delete_volume" :: held 0.724s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Created reservations ['d84fac35-abb0-4b5d-8672-0ee309200ffb', 'c665ec20-c927-442b-a389-bbd98f51ad5b', '61461229-fdc6-424c-bab1-9759e87919c6', '83e06502-177a-4c42-9ce1-3f47da4028d5', '51cb8ebc-5998-44c6-a7dc-d1e99d72bea0'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:19 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:19 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:19 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:19 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Deleted volume successfully. Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b200ea48-937d-4388-8f5a-b00b6a2f0dd3 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-2853005f-b553-404e-884f-41b402dd1333-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (1d1d08c1-634b-401f-958b-ace74cbc48fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35282d6c-0885-4e32-a2e1-942bed57224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35282d6c-0885-4e32-a2e1-942bed57224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991607500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ad93e3-cf32-48f2-b7e3-499b7923a369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:20Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ccfe0-d80a-4343-955c-11558605402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51ccfe0-d80a-4343-955c-11558605402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9bd6a-b331-456c-b2b1-2cee2d3578ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9bd6a-b331-456c-b2b1-2cee2d3578ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ad93e3-cf32-48f2-b7e3-499b7923a369', 'volume_name': 'volume-14ad93e3-cf32-48f2-b7e3-499b7923a369', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db244e61-415f-4ba5-80bd-9063cdb762e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db244e61-415f-4ba5-80bd-9063cdb762e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a580354e-93cb-4546-82ae-6639fc238cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Volume 14ad93e3-cf32-48f2-b7e3-499b7923a369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ad93e3-cf32-48f2-b7e3-499b7923a369', 'volume_size': 1} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1991607500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ad93e3-cf32-48f2-b7e3-499b7923a369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256e0d45fd3847dda8b50b606c1507d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:20Z,use_quota=True,user_id='3abdd0b249fe497ebee26cf5f09022f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Creating volume 14ad93e3-cf32-48f2-b7e3-499b7923a369 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:20 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 1073741824 Sep 23 00:38:20 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:20 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 1073741824" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:21 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 Sep 23 00:38:21 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:21 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a580354e-93cb-4546-82ae-6639fc238cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ad93e3-cf32-48f2-b7e3-499b7923a369', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b79dc3e-53bd-4842-8ca3-e74b07cdaaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Volume volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 (14ad93e3-cf32-48f2-b7e3-499b7923a369): created successfully Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b79dc3e-53bd-4842-8ca3-e74b07cdaaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Flow 'volume_create_manager' (1d1d08c1-634b-401f-958b-ace74cbc48fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0b011586-138f-4586-b5e2-f7d94a085088 tempest-ProjectReaderTests-1124809976 None] Created volume successfully. Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-14ad93e3-cf32-48f2-b7e3-499b7923a369-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-14ad93e3-cf32-48f2-b7e3-499b7923a369-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "cinder-quobyte-14ad93e3-cf32-48f2-b7e3-499b7923a369" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-14ad93e3-cf32-48f2-b7e3-499b7923a369" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[179b4c33-7ddc-4247-abda-5b8fa83bc4bf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:21 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 Sep 23 00:38:21 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:21 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369" returned: 0 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:21 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369 Sep 23 00:38:21 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:22 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-14ad93e3-cf32-48f2-b7e3-499b7923a369" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-quobyte-14ad93e3-cf32-48f2-b7e3-499b7923a369" released by "delete_volume" :: held 0.702s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Created reservations ['e6a9d8f4-600f-4fb1-8f5c-c59b9733ca87', 'd7f0e3b2-f10c-40db-a4d3-e03dfb1fc3e6', 'c4febb92-f857-4868-acb9-86b9f6c2f983', '548531cd-a7f5-4876-8191-dc0aaa13a2d1', 'e468fbc9-3afe-4b3a-8fa6-0a3a86039381'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:22 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:22 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:22 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Deleted volume successfully. Sep 23 00:38:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3827bdc4-329f-48ba-aac3-6b414cb03af7 tempest-ProjectReaderTests-1124809976 None] Lock "cinder-14ad93e3-cf32-48f2-b7e3-499b7923a369-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:32 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=59,cinder:UPDATE=87,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:32 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=94,cinder:DELETE=6,cinder:INSERT=19,cinder:SELECT=70 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Flow 'volume_create_manager' (b4d996a5-32e7-4bd7-831b-8cdabcdbc227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58a715c-3fb4-4136-8f4e-501302873f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58a715c-3fb4-4136-8f4e-501302873f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795213059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eb20f5-ca34-46df-bbb6-91fbf58c8bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b059a36e90d4cdbac94a2fa22e59a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:37Z,use_quota=True,user_id='2ce0ac5e4af341b19f361a8a10ce34f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e18d22-c99d-4d84-84f9-63cf719b0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e18d22-c99d-4d84-84f9-63cf719b0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd00deb-400c-430f-a8a7-238f68858f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd00deb-400c-430f-a8a7-238f68858f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93eb20f5-ca34-46df-bbb6-91fbf58c8bae', 'volume_name': 'volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2b7c3-cc69-40fb-bb38-18c6d1fb9aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2b7c3-cc69-40fb-bb38-18c6d1fb9aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543dbfb8-3bb4-4817-884d-20ca3ffb6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Volume 93eb20f5-ca34-46df-bbb6-91fbf58c8bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae', 'volume_size': 1} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-795213059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eb20f5-ca34-46df-bbb6-91fbf58c8bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b059a36e90d4cdbac94a2fa22e59a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:37Z,use_quota=True,user_id='2ce0ac5e4af341b19f361a8a10ce34f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Creating volume 93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:37 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] casted to osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae 1073741824 Sep 23 00:38:37 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:37 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae 1073741824" returned: 0 in 0.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:37 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ac00f6f8-bda9-4638-99b1-4600db0d3cd9 None None] thread info: [<_MainThread(MainThread, started 137457105813632)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:38:37 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.238s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543dbfb8-3bb4-4817-884d-20ca3ffb6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b5b9af-5db2-494b-b6d2-f6b2ec269af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Volume volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae (93eb20f5-ca34-46df-bbb6-91fbf58c8bae): created successfully Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b5b9af-5db2-494b-b6d2-f6b2ec269af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Flow 'volume_create_manager' (b4d996a5-32e7-4bd7-831b-8cdabcdbc227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0fe3f4d0-abca-4e83-98c6-814e393b2f68 tempest-SnapshotDependencyTests-275136696 None] Created volume successfully. Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Creating offline snapshot d96294d6-27ae-4355-8da3-cf6ae0cd7420 of volume 93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a297c149-76cb-44d7-a7e8-ad66e80e811d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:38 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 1G Sep 23 00:38:38 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 1G" returned: 0 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:39 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae -F qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 is being set with open permissions: ugo+rw Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:39 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.231s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info Sep 23 00:38:39 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info" returned: 0 in 0.233s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info is being set with open permissions: ugo+rw Sep 23 00:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info Sep 23 00:38:39 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:40 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.info" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d660fd1f-7878-44d8-9614-20a8922dfc53 tempest-SnapshotDependencyTests-275136696 None] Create snapshot completed successfully Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Flow 'volume_create_manager' (d8e48359-f126-4e06-bb18-5c10351e4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c036b3af-5fdc-4455-aac2-96ddb4507340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c036b3af-5fdc-4455-aac2-96ddb4507340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de75e8a5-2a2a-4f5e-8776-9d258b97bb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b059a36e90d4cdbac94a2fa22e59a41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d96294d6-27ae-4355-8da3-cf6ae0cd7420,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:41Z,use_quota=True,user_id='2ce0ac5e4af341b19f361a8a10ce34f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51142623-231e-45e8-92e5-944ea7a2d4ed),volume_type_id=51142623-231e-45e8-92e5-944ea7a2d4ed)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b158858d-582d-4143-b658-b080f4793ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b158858d-582d-4143-b658-b080f4793ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4361d4-391c-4aa2-a737-68a0e71cd8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4361d4-391c-4aa2-a737-68a0e71cd8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de75e8a5-2a2a-4f5e-8776-9d258b97bb8c', 'volume_name': 'volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c', 'volume_size': 1, 'snapshot_id': 'd96294d6-27ae-4355-8da3-cf6ae0cd7420'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8546925-dcb9-40c3-8487-30bf44b7ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8546925-dcb9-40c3-8487-30bf44b7ead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e9f303-763a-42fb-a385-799a86b2c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Volume de75e8a5-2a2a-4f5e-8776-9d258b97bb8c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c', 'volume_size': 1, 'snapshot_id': 'd96294d6-27ae-4355-8da3-cf6ae0cd7420'} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Creating volume de75e8a5-2a2a-4f5e-8776-9d258b97bb8c from snapshot d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Selected osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] snapshot: d96294d6-27ae-4355-8da3-cf6ae0cd7420, volume: de75e8a5-2a2a-4f5e-8776-9d258b97bb8c, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af05a7-c1af-469e-aea1-d5a73cdd297d]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:41 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:41 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:41 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad5860-989e-4628-86eb-f3c63bdddb52]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:41 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:41 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:41 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Path /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:41 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c Sep 23 00:38:41 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:47 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" returned: 0 in 5.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Image conversion details: src /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:38:47 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Converted 1024.00 MB image at 192.10 MB/s Sep 23 00:38:47 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c is being set with open permissions: ugo+rw Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:47 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c Sep 23 00:38:47 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:47 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" returned: 0 in 0.236s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" released by "_copy_volume_from_snapshot" :: held 6.340s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" released by "_create_volume_from_snapshot" :: held 6.395s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.409s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e9f303-763a-42fb-a385-799a86b2c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c', 'volume_size': 1, 'snapshot_id': 'd96294d6-27ae-4355-8da3-cf6ae0cd7420'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf59bfd-ddef-48a8-a0a8-d8eb91912a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Volume volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c (de75e8a5-2a2a-4f5e-8776-9d258b97bb8c): created successfully Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf59bfd-ddef-48a8-a0a8-d8eb91912a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Flow 'volume_create_manager' (d8e48359-f126-4e06-bb18-5c10351e4828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-85ffffc6-f652-4607-a93c-ba27d77aa6c1 tempest-SnapshotDependencyTests-275136696 None] Created volume successfully. Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-d96294d6-27ae-4355-8da3-cf6ae0cd7420-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-d96294d6-27ae-4355-8da3-cf6ae0cd7420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Deleting offline snapshot d96294d6-27ae-4355-8da3-cf6ae0cd7420 of volume 93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] snapshot_file for this snap is: volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[208be6a7-d67c-4a7c-8c83-8249d3049c72]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:48 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:48 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.337s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd982f49-f319-4220-b324-c20904f6bcc3]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:48 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.509s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:49 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:49 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:49 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420 Sep 23 00:38:49 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae.d96294d6-27ae-4355-8da3-cf6ae0cd7420" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-d96294d6-27ae-4355-8da3-cf6ae0cd7420" released by "_delete_snapshot" :: held 1.525s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" released by "delete_snapshot" :: held 1.547s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Created reservations ['5deaee67-deb4-4250-b9ec-8185fb135f53', 'a88d106c-1d7e-4971-9217-2bca56a51e82', '35ca5ab6-b137-4a2d-b3dd-8dce1d6db6cf', 'd7acdc5d-834b-48af-9ac1-3e7de33585d2', 'a02a6ae5-c904-49bd-93aa-97b0f75cc03a'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Delete snapshot completed successfully. Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89a857a0-bf19-40a0-904a-4d2c1c851c3e tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-d96294d6-27ae-4355-8da3-cf6ae0cd7420-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-93eb20f5-ca34-46df-bbb6-91fbf58c8bae-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-93eb20f5-ca34-46df-bbb6-91fbf58c8bae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" acquired by "delete_volume" :: waited 0.012s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d864249-8ba4-4ccb-881b-0b5300943c8c]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:50 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:50 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:51 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae Sep 23 00:38:51 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" returned: 0 in 0.231s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-93eb20f5-ca34-46df-bbb6-91fbf58c8bae" released by "delete_volume" :: held 0.642s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Created reservations ['187cf0ba-03a1-47b4-8efa-ac77a757c485', '9b674b1e-306a-4834-97e3-b9e292761f22', '436faa28-527d-43aa-a1c4-3b1f28f77510', '41704507-294f-4dda-ab1e-ca7b8815b169', 'e7417f28-953a-4b74-b881-ef75ef8d443e'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:51 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:51 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.238s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Deleted volume successfully. Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0579d501-e588-4aee-bc4f-5f06d4d2ed7b tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-93eb20f5-ca34-46df-bbb6-91fbf58c8bae-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1236d22e-1bc4-4b44-a987-603292537fcf]: (4, 'qcow2') {{(pid=87751) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:51 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c Sep 23 00:38:51 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:52 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:52 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c Sep 23 00:38:52 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:52 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2/volume-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" returned: 0 in 0.229s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-quobyte-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c" released by "delete_volume" :: held 0.606s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Created reservations ['581cec5a-9985-4dd8-80d3-20aed85c25cb', '421b4398-87a4-403e-8f5f-9c583469a9b8', '61f736cb-49c0-4080-9ca2-e1da9ce0dd25', '95d65647-fe81-4bf4-93f5-cb6163b65345', '547b3d60-3f72-4869-b4cf-ac86c95ab348'] {{(pid=86731) _reserve /opt/stack/cinder/cinder/quota.py:796}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5477a5f7-73a6-4bbd-aba1-3a998302c771'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:52 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2 Sep 23 00:38:52 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:52 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5cbd8605465e61821c5f5e238e5853b2" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Deleted volume successfully. Sep 23 00:38:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d410f94a-3e20-4f8e-bd7b-43429af1a966 tempest-SnapshotDependencyTests-275136696 None] Lock "cinder-de75e8a5-2a2a-4f5e-8776-9d258b97bb8c-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:02 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:39:02 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}